Apr 13 18:52:22 user nova-compute[71692]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 13 18:52:24 user nova-compute[71692]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71692) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 18:52:24 user nova-compute[71692]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71692) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 18:52:24 user nova-compute[71692]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71692) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 18:52:24 user nova-compute[71692]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:52:25 user nova-compute[71692]: INFO nova.virt.driver [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 13 18:52:25 user nova-compute[71692]: INFO nova.compute.provider_config [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] Acquiring lock "singleton_lock" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] Acquired lock "singleton_lock" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] Releasing lock "singleton_lock" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] Full set of CONF: {{(pid=71692) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ******************************************************************************** {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] Configuration options gathered from: {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ================================================================================ {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] allow_resize_to_same_host      = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] arq_binding_timeout            = 300 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] backdoor_port                  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] backdoor_socket                = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] block_device_allocate_retries  = 300 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] block_device_allocate_retries_interval = 5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cert                           = self.pem {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] compute_monitors               = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] config_dir                     = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] config_drive_format            = iso9660 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] config_source                  = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] console_host                   = user {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] control_exchange               = nova {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cpu_allocation_ratio           = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] daemon                         = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] debug                          = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] default_access_ip_network_name = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] default_availability_zone      = nova {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] default_ephemeral_format       = ext4 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] default_schedule_zone          = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] disk_allocation_ratio          = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] enable_new_services            = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] enabled_ssl_apis               = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] flat_injected                  = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] force_config_drive             = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] force_raw_images               = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] graceful_shutdown_timeout      = 5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] heal_instance_info_cache_interval = 60 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] host                           = user {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] instance_build_timeout         = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] instance_delete_interval       = 300 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] instance_name_template         = instance-%08x {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] instance_usage_audit           = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] instance_usage_audit_period    = month {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] internal_service_availability_zone = internal {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] key                            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] live_migration_retry_count     = 30 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] log_config_append              = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] log_dir                        = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] log_file                       = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] log_options                    = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] log_rotate_interval            = 1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] log_rotate_interval_type       = days {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] log_rotation_type              = none {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] long_rpc_timeout               = 1800 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] max_concurrent_builds          = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] max_concurrent_live_migrations = 1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] max_concurrent_snapshots       = 5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] max_local_block_devices        = 3 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] max_logfile_count              = 30 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] max_logfile_size_mb            = 200 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] maximum_instance_delete_attempts = 5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] metadata_listen                = 0.0.0.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] metadata_listen_port           = 8775 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] metadata_workers               = 3 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] migrate_max_retries            = -1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] mkisofs_cmd                    = genisoimage {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] my_ip                          = 10.0.0.210 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] network_allocate_retries       = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] osapi_compute_listen_port      = 8774 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] osapi_compute_unique_server_name_scope =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] osapi_compute_workers          = 3 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] password_length                = 12 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] periodic_enable                = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] periodic_fuzzy_delay           = 60 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] pointer_model                  = ps2mouse {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] preallocate_images             = none {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] publish_errors                 = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] pybasedir                      = /opt/stack/nova {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ram_allocation_ratio           = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] rate_limit_burst               = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] rate_limit_except_level        = CRITICAL {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] rate_limit_interval            = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] reboot_timeout                 = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] reclaim_instance_interval      = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] record                         = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] reimage_timeout_per_gb         = 20 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] report_interval                = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] rescue_timeout                 = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] reserved_host_cpus             = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] reserved_host_disk_mb          = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] reserved_host_memory_mb        = 512 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] reserved_huge_pages            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] resize_confirm_window          = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] resize_fs_using_block_device   = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] resume_guests_state_on_host_boot = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] rpc_response_timeout           = 60 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] run_external_periodic_tasks    = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] running_deleted_instance_action = reap {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] running_deleted_instance_timeout = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] scheduler_instance_sync_interval = 120 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] service_down_time              = 60 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] servicegroup_driver            = db {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] shelved_offload_time           = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] shelved_poll_interval          = 3600 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] shutdown_timeout               = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] source_is_ipv6                 = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ssl_only                       = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] state_path                     = /opt/stack/data/nova {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] sync_power_state_interval      = 600 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] sync_power_state_pool_size     = 1000 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] syslog_log_facility            = LOG_USER {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] tempdir                        = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] timeout_nbd                    = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] transport_url                  = **** {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] update_resources_interval      = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] use_cow_images                 = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] use_eventlog                   = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] use_journal                    = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] use_json                       = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] use_rootwrap_daemon            = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] use_stderr                     = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] use_syslog                     = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vcpu_pin_set                   = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vif_plugging_is_fatal          = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vif_plugging_timeout           = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] virt_mkfs                      = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] volume_usage_poll_interval     = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] watch_log_file                 = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] web                            = /usr/share/spice-html5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_concurrency.disable_process_locking = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.auth_strategy              = keystone {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.compute_link_prefix        = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.dhcp_domain                = novalocal {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.enable_instance_password   = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.glance_link_prefix         = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.instance_list_per_project_cells = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.list_records_by_skipping_down_cells = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.local_metadata_per_cell    = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.max_limit                  = 1000 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.metadata_cache_expiration  = 15 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.neutron_default_tenant_id  = default {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.use_forwarded_for          = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.use_neutron_default_nets   = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.vendordata_dynamic_targets = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.vendordata_jsonfile_path   = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.backend_argument         = **** {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.config_prefix            = cache.oslo {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.dead_timeout             = 60.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.debug_cache_backend      = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.enable_retry_client      = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.enable_socket_keepalive  = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.enabled                  = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.expiration_time          = 600 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.hashclient_retry_attempts = 2 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.memcache_dead_retry      = 300 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.memcache_password        =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.memcache_sasl_enabled    = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.memcache_username        =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.proxies                  = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.retry_attempts           = 2 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.retry_delay              = 0.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.socket_keepalive_count   = 1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.socket_keepalive_idle    = 1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.socket_keepalive_interval = 1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.tls_allowed_ciphers      = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.tls_cafile               = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.tls_certfile             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.tls_enabled              = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cache.tls_keyfile              = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cinder.auth_section            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cinder.auth_type               = password {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cinder.cafile                  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cinder.certfile                = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cinder.collect_timing          = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cinder.cross_az_attach         = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cinder.debug                   = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cinder.endpoint_template       = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cinder.http_retries            = 3 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cinder.insecure                = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cinder.keyfile                 = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cinder.os_region_name          = RegionOne {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cinder.split_loggers           = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cinder.timeout                 = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] compute.cpu_dedicated_set      = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] compute.cpu_shared_set         = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] compute.image_type_exclude_list = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] compute.resource_provider_association_refresh = 300 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] compute.shutdown_retry_interval = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] conductor.workers              = 3 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] console.allowed_origins        = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] console.ssl_ciphers            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] console.ssl_minimum_version    = default {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] consoleauth.token_ttl          = 600 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.cafile                  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.certfile                = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.collect_timing          = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.connect_retries         = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.connect_retry_delay     = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.endpoint_override       = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.insecure                = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.keyfile                 = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.max_version             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.min_version             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.region_name             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.service_name            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.service_type            = accelerator {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.split_loggers           = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.status_code_retries     = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.status_code_retry_delay = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.timeout                 = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] cyborg.version                 = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.backend               = sqlalchemy {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.connection            = **** {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.connection_debug      = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.connection_parameters =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.connection_recycle_time = 3600 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.connection_trace      = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.db_inc_retry_interval = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.db_max_retries        = 20 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.db_max_retry_interval = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.db_retry_interval     = 1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.max_overflow          = 50 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.max_pool_size         = 5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.max_retries           = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.mysql_enable_ndb      = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.mysql_wsrep_sync_wait = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.pool_timeout          = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.retry_interval        = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.slave_connection      = **** {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] database.sqlite_synchronous    = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.backend           = sqlalchemy {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.connection        = **** {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.connection_debug  = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.connection_parameters =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.connection_recycle_time = 3600 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.connection_trace  = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.db_inc_retry_interval = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.db_max_retries    = 20 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.db_max_retry_interval = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.db_retry_interval = 1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.max_overflow      = 50 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.max_pool_size     = 5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.max_retries       = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.mysql_enable_ndb  = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.pool_timeout      = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.retry_interval    = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.slave_connection  = **** {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] api_database.sqlite_synchronous = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] devices.enabled_mdev_types     = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ephemeral_storage_encryption.enabled = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.api_servers             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.cafile                  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.certfile                = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.collect_timing          = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.connect_retries         = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.connect_retry_delay     = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.debug                   = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.default_trusted_certificate_ids = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.enable_certificate_validation = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.enable_rbd_download     = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.endpoint_override       = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.insecure                = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.keyfile                 = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.max_version             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.min_version             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.num_retries             = 3 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.rbd_ceph_conf           =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.rbd_connect_timeout     = 5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.rbd_pool                =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.rbd_user                =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.region_name             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.service_name            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.service_type            = image {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.split_loggers           = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.status_code_retries     = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.status_code_retry_delay = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.timeout                 = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.verify_glance_signatures = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] glance.version                 = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] guestfs.debug                  = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.config_drive_cdrom      = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.config_drive_inject_password = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.enable_remotefx         = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.instances_path_share    =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.limit_cpu_features      = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.use_multipath_io        = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.vswitch_name            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] mks.enabled                    = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] image_cache.manager_interval   = 2400 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] image_cache.precache_concurrency = 1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] image_cache.remove_unused_base_images = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] image_cache.subdirectory_name  = _base {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.api_max_retries         = 60 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.api_retry_interval      = 2 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.auth_section            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.auth_type               = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.cafile                  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.certfile                = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.collect_timing          = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.connect_retries         = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.connect_retry_delay     = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.endpoint_override       = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.insecure                = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.keyfile                 = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.max_version             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.min_version             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.partition_key           = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.peer_list               = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.region_name             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.serial_console_state_timeout = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.service_name            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.service_type            = baremetal {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.split_loggers           = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.status_code_retries     = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.status_code_retry_delay = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.timeout                 = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ironic.version                 = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] key_manager.fixed_key          = **** {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican.barbican_api_version  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican.barbican_endpoint     = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican.barbican_endpoint_type = public {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican.barbican_region_name  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican.cafile                = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican.certfile              = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican.collect_timing        = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican.insecure              = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican.keyfile               = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican.number_of_retries     = 60 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican.retry_delay           = 1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican.send_service_user_token = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican.split_loggers         = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican.timeout               = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican.verify_ssl            = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican.verify_ssl_path       = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican_service_user.auth_section = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican_service_user.auth_type = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican_service_user.cafile   = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican_service_user.certfile = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican_service_user.collect_timing = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican_service_user.insecure = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican_service_user.keyfile  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican_service_user.split_loggers = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] barbican_service_user.timeout  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vault.approle_role_id          = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vault.approle_secret_id        = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vault.cafile                   = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vault.certfile                 = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vault.collect_timing           = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vault.insecure                 = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vault.keyfile                  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vault.kv_mountpoint            = secret {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vault.kv_version               = 2 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vault.namespace                = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vault.root_token_id            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vault.split_loggers            = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vault.ssl_ca_crt_file          = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vault.timeout                  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vault.use_ssl                  = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.cafile                = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.certfile              = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.collect_timing        = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.connect_retries       = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.connect_retry_delay   = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.endpoint_override     = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.insecure              = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.keyfile               = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.max_version           = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.min_version           = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.region_name           = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.service_name          = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.service_type          = identity {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.split_loggers         = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.status_code_retries   = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.status_code_retry_delay = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.timeout               = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] keystone.version               = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.connection_uri         =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.cpu_mode               = custom {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: WARNING oslo_config.cfg [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.cpu_power_governor_high = performance {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.cpu_power_management   = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.device_detach_attempts = 8 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.device_detach_timeout  = 20 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.disk_cachemodes        = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.disk_prefix            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.enabled_perf_events    = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.file_backed_memory     = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.gid_maps               = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.hw_disk_discard        = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.hw_machine_type        = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.images_rbd_pool        = rbd {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.images_type            = default {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.images_volume_group    = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.inject_key             = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.inject_partition       = -2 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.inject_password        = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.iscsi_iface            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.iser_use_multipath     = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.live_migration_downtime = 500 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.live_migration_inbound_addr = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.live_migration_scheme  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.live_migration_timeout_action = abort {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.live_migration_tunnelled = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: WARNING oslo_config.cfg [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 13 18:52:25 user nova-compute[71692]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 13 18:52:25 user nova-compute[71692]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 13 18:52:25 user nova-compute[71692]: and ``live_migration_inbound_addr`` respectively.
Apr 13 18:52:25 user nova-compute[71692]: ).  Its value may be silently ignored in the future.
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.live_migration_with_native_tls = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.max_queues             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.nfs_mount_options      = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.num_pcie_ports         = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.pmem_namespaces        = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.quobyte_client_cfg     = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.rbd_secret_uuid        = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.rbd_user               = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.rescue_image_id        = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.rescue_kernel_id       = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.rx_queue_size          = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.smbfs_mount_options    =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.snapshot_compression   = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.snapshot_image_format  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.sparse_logical_volumes = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.swtpm_enabled          = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.swtpm_group            = tss {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.swtpm_user             = tss {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.sysinfo_serial         = unique {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.tx_queue_size          = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.uid_maps               = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.use_virtio_for_bridges = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.virt_type              = kvm {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.volume_clear           = zero {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.volume_clear_size      = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.volume_use_multipath   = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.vzstorage_cache_path   = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.auth_section           = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.auth_type              = password {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.cafile                 = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.certfile               = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.collect_timing         = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.connect_retries        = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.connect_retry_delay    = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.default_floating_pool  = public {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.endpoint_override      = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.extension_sync_interval = 600 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.http_retries           = 3 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.insecure               = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.keyfile                = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.max_version            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.min_version            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.ovs_bridge             = br-int {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.physnets               = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.region_name            = RegionOne {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.service_metadata_proxy = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.service_name           = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.service_type           = network {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.split_loggers          = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.status_code_retries    = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.status_code_retry_delay = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.timeout                = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] neutron.version                = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] notifications.bdms_in_notifications = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] notifications.default_level    = INFO {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] notifications.notification_format = unversioned {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] notifications.notify_on_state_change = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] pci.alias                      = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] pci.device_spec                = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] pci.report_in_placement        = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.auth_section         = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.auth_type            = password {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.cafile               = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.certfile             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.collect_timing       = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.connect_retries      = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.connect_retry_delay  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.default_domain_id    = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.default_domain_name  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.domain_id            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.domain_name          = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.endpoint_override    = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.insecure             = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.keyfile              = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.max_version          = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.min_version          = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.password             = **** {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.project_domain_id    = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.project_domain_name  = Default {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.project_id           = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.project_name         = service {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.region_name          = RegionOne {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.service_name         = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.service_type         = placement {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.split_loggers        = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.status_code_retries  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.status_code_retry_delay = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.system_scope         = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.timeout              = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.trust_id             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.user_domain_id       = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.user_domain_name     = Default {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.user_id              = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.username             = placement {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] placement.version              = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] quota.cores                    = 20 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] quota.count_usage_from_placement = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] quota.injected_file_content_bytes = 10240 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] quota.injected_file_path_length = 255 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] quota.injected_files           = 5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] quota.instances                = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] quota.key_pairs                = 100 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] quota.metadata_items           = 128 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] quota.ram                      = 51200 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] quota.recheck_quota            = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] quota.server_group_members     = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] quota.server_groups            = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] rdp.enabled                    = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] scheduler.image_metadata_prefilter = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] scheduler.max_attempts         = 3 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] scheduler.max_placement_results = 1000 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] scheduler.workers              = 3 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.host_subset_size = 1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.isolated_hosts = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.isolated_images = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.pci_in_placement = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.track_instance_changes = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] metrics.required               = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] metrics.weight_multiplier      = 1.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] metrics.weight_setting         = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] serial_console.enabled         = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] serial_console.port_range      = 10000:20000 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] serial_console.serialproxy_port = 6083 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] service_user.auth_section      = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] service_user.auth_type         = password {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] service_user.cafile            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] service_user.certfile          = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] service_user.collect_timing    = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] service_user.insecure          = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] service_user.keyfile           = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] service_user.send_service_user_token = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] service_user.split_loggers     = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] service_user.timeout           = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] spice.agent_enabled            = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] spice.enabled                  = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] spice.html5proxy_port          = 6082 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] spice.image_compression        = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] spice.jpeg_compression         = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] spice.playback_compression     = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] spice.server_listen            = 127.0.0.1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] spice.streaming_mode           = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] spice.zlib_compression         = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] upgrade_levels.baseapi         = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] upgrade_levels.cert            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] upgrade_levels.compute         = auto {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] upgrade_levels.conductor       = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] upgrade_levels.scheduler       = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vendordata_dynamic_auth.cafile = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vendordata_dynamic_auth.certfile = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vendordata_dynamic_auth.insecure = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vendordata_dynamic_auth.timeout = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.api_retry_count         = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.ca_file                 = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.cache_prefix            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.cluster_name            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.connection_pool_size    = 10 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.console_delay_seconds   = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.datastore_regex         = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.host_ip                 = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.host_password           = **** {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.host_port               = 443 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.host_username           = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.insecure                = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.integration_bridge      = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.maximum_objects         = 100 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.pbm_default_policy      = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.pbm_enabled             = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.pbm_wsdl_location       = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.serial_port_proxy_uri   = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.serial_port_service_uri = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.task_poll_interval      = 0.5 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.use_linked_clone        = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.vnc_keymap              = en-us {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.vnc_port                = 5900 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vmware.vnc_port_total          = 10000 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vnc.auth_schemes               = ['none'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vnc.enabled                    = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vnc.novncproxy_port            = 6080 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vnc.vencrypt_ca_certs          = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vnc.vencrypt_client_cert       = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vnc.vencrypt_client_key        = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.disable_rootwrap   = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.enable_numa_live_migration = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.libvirt_disable_apic = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] wsgi.client_socket_timeout     = 900 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] wsgi.default_pool_size         = 1000 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] wsgi.keep_alive                = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] wsgi.max_header_line           = 16384 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] wsgi.ssl_ca_file               = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] wsgi.ssl_cert_file             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] wsgi.ssl_key_file              = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] wsgi.tcp_keepidle              = 600 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] zvm.ca_file                    = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] zvm.cloud_connector_url        = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] zvm.reachable_timeout          = 300 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_policy.enforce_new_defaults = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_policy.enforce_scope      = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_policy.policy_default_rule = default {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] profiler.connection_string     = messaging:// {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] profiler.enabled               = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] profiler.es_doc_type           = notification {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] profiler.es_scroll_size        = 10000 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] profiler.es_scroll_time        = 2m {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] profiler.filter_error_trace    = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] profiler.sentinel_service_name = mymaster {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] profiler.socket_timeout        = 0.1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] profiler.trace_sqlalchemy      = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] remote_debug.host              = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] remote_debug.port              = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_notifications.retry = -1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.auth_section        = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.auth_type           = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.cafile              = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.certfile            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.collect_timing      = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.connect_retries     = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.connect_retry_delay = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.endpoint_id         = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.endpoint_override   = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.insecure            = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.keyfile             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.max_version         = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.min_version         = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.region_name         = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.service_name        = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.service_type        = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.split_loggers       = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.status_code_retries = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.status_code_retry_delay = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.timeout             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.valid_interfaces    = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_limit.version             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_reports.file_event_handler = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] oslo_reports.log_dir           = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vif_plug_ovs_privileged.group  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] vif_plug_ovs_privileged.user   = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] os_vif_ovs.isolate_vif         = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] os_brick.lock_path             = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] privsep_osbrick.capabilities   = [21] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] privsep_osbrick.group          = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] privsep_osbrick.helper_command = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] privsep_osbrick.user           = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] nova_sys_admin.group           = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] nova_sys_admin.helper_command  = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] nova_sys_admin.user            = None {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG oslo_service.service [None req-08bb7ea5-98f6-4b3c-bc92-bed7d7dc80f6 None None] ******************************************************************************** {{(pid=71692) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 13 18:52:25 user nova-compute[71692]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 13 18:52:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Starting native event thread {{(pid=71692) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Starting green dispatch thread {{(pid=71692) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Starting connection event dispatch thread {{(pid=71692) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Connecting to libvirt: qemu:///system {{(pid=71692) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7febd4ab65f0> {{(pid=71692) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 13 18:52:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7febd4ab65f0> {{(pid=71692) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 13 18:52:25 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Connection event '1' reason 'None'
Apr 13 18:52:25 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 13 18:52:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.mount [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Initialising _HostMountState generation 0 {{(pid=71692) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 13 18:52:33 user nova-compute[71692]: INFO nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Libvirt host capabilities <capabilities>
Apr 13 18:52:33 user nova-compute[71692]:   <host>
Apr 13 18:52:33 user nova-compute[71692]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 13 18:52:33 user nova-compute[71692]:     <cpu>
Apr 13 18:52:33 user nova-compute[71692]:       <arch>x86_64</arch>
Apr 13 18:52:33 user nova-compute[71692]:       <model>IvyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <vendor>Intel</vendor>
Apr 13 18:52:33 user nova-compute[71692]:       <microcode version='1070'/>
Apr 13 18:52:33 user nova-compute[71692]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 13 18:52:33 user nova-compute[71692]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature name='ss'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature name='vmx'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature name='pcid'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature name='osxsave'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature name='hypervisor'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature name='arat'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature name='tsc_adjust'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature name='md-clear'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature name='stibp'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature name='arch-capabilities'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature name='ssbd'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature name='invtsc'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature name='rsba'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature name='skip-l1dfl-vmentry'/>
Apr 13 18:52:33 user nova-compute[71692]:       <pages unit='KiB' size='4'/>
Apr 13 18:52:33 user nova-compute[71692]:       <pages unit='KiB' size='2048'/>
Apr 13 18:52:33 user nova-compute[71692]:     </cpu>
Apr 13 18:52:33 user nova-compute[71692]:     <power_management>
Apr 13 18:52:33 user nova-compute[71692]:       <suspend_mem/>
Apr 13 18:52:33 user nova-compute[71692]:       <suspend_disk/>
Apr 13 18:52:33 user nova-compute[71692]:       <suspend_hybrid/>
Apr 13 18:52:33 user nova-compute[71692]:     </power_management>
Apr 13 18:52:33 user nova-compute[71692]:     <iommu support='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     <migration_features>
Apr 13 18:52:33 user nova-compute[71692]:       <live/>
Apr 13 18:52:33 user nova-compute[71692]:       <uri_transports>
Apr 13 18:52:33 user nova-compute[71692]:         <uri_transport>tcp</uri_transport>
Apr 13 18:52:33 user nova-compute[71692]:         <uri_transport>rdma</uri_transport>
Apr 13 18:52:33 user nova-compute[71692]:       </uri_transports>
Apr 13 18:52:33 user nova-compute[71692]:     </migration_features>
Apr 13 18:52:33 user nova-compute[71692]:     <topology>
Apr 13 18:52:33 user nova-compute[71692]:       <cells num='2'>
Apr 13 18:52:33 user nova-compute[71692]:         <cell id='0'>
Apr 13 18:52:33 user nova-compute[71692]:           <memory unit='KiB'>8189224</memory>
Apr 13 18:52:33 user nova-compute[71692]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 13 18:52:33 user nova-compute[71692]:           <pages unit='KiB' size='2048'>0</pages>
Apr 13 18:52:33 user nova-compute[71692]:           <distances>
Apr 13 18:52:33 user nova-compute[71692]:             <sibling id='0' value='10'/>
Apr 13 18:52:33 user nova-compute[71692]:             <sibling id='1' value='20'/>
Apr 13 18:52:33 user nova-compute[71692]:           </distances>
Apr 13 18:52:33 user nova-compute[71692]:           <cpus num='6'>
Apr 13 18:52:33 user nova-compute[71692]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 13 18:52:33 user nova-compute[71692]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 13 18:52:33 user nova-compute[71692]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 13 18:52:33 user nova-compute[71692]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 13 18:52:33 user nova-compute[71692]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 13 18:52:33 user nova-compute[71692]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 13 18:52:33 user nova-compute[71692]:           </cpus>
Apr 13 18:52:33 user nova-compute[71692]:         </cell>
Apr 13 18:52:33 user nova-compute[71692]:         <cell id='1'>
Apr 13 18:52:33 user nova-compute[71692]:           <memory unit='KiB'>8218764</memory>
Apr 13 18:52:33 user nova-compute[71692]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 13 18:52:33 user nova-compute[71692]:           <pages unit='KiB' size='2048'>0</pages>
Apr 13 18:52:33 user nova-compute[71692]:           <distances>
Apr 13 18:52:33 user nova-compute[71692]:             <sibling id='0' value='20'/>
Apr 13 18:52:33 user nova-compute[71692]:             <sibling id='1' value='10'/>
Apr 13 18:52:33 user nova-compute[71692]:           </distances>
Apr 13 18:52:33 user nova-compute[71692]:           <cpus num='6'>
Apr 13 18:52:33 user nova-compute[71692]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 13 18:52:33 user nova-compute[71692]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 13 18:52:33 user nova-compute[71692]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 13 18:52:33 user nova-compute[71692]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 13 18:52:33 user nova-compute[71692]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 13 18:52:33 user nova-compute[71692]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 13 18:52:33 user nova-compute[71692]:           </cpus>
Apr 13 18:52:33 user nova-compute[71692]:         </cell>
Apr 13 18:52:33 user nova-compute[71692]:       </cells>
Apr 13 18:52:33 user nova-compute[71692]:     </topology>
Apr 13 18:52:33 user nova-compute[71692]:     <cache>
Apr 13 18:52:33 user nova-compute[71692]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 13 18:52:33 user nova-compute[71692]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 13 18:52:33 user nova-compute[71692]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 13 18:52:33 user nova-compute[71692]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 13 18:52:33 user nova-compute[71692]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 13 18:52:33 user nova-compute[71692]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 13 18:52:33 user nova-compute[71692]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 13 18:52:33 user nova-compute[71692]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 13 18:52:33 user nova-compute[71692]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 13 18:52:33 user nova-compute[71692]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 13 18:52:33 user nova-compute[71692]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 13 18:52:33 user nova-compute[71692]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 13 18:52:33 user nova-compute[71692]:     </cache>
Apr 13 18:52:33 user nova-compute[71692]:     <secmodel>
Apr 13 18:52:33 user nova-compute[71692]:       <model>apparmor</model>
Apr 13 18:52:33 user nova-compute[71692]:       <doi>0</doi>
Apr 13 18:52:33 user nova-compute[71692]:     </secmodel>
Apr 13 18:52:33 user nova-compute[71692]:     <secmodel>
Apr 13 18:52:33 user nova-compute[71692]:       <model>dac</model>
Apr 13 18:52:33 user nova-compute[71692]:       <doi>0</doi>
Apr 13 18:52:33 user nova-compute[71692]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 13 18:52:33 user nova-compute[71692]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 13 18:52:33 user nova-compute[71692]:     </secmodel>
Apr 13 18:52:33 user nova-compute[71692]:   </host>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='alpha'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>64</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>clipper</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='armv6l'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>32</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>spitz</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>nuri</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>kzm</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>sx1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>z2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>tosa</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>n810</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>n800</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>terrier</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>midway</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>microbit</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>verdex</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>highbank</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>akita</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>connex</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>collie</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='armv7l'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>32</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>spitz</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>nuri</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>kzm</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>sx1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>z2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>tosa</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>n810</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>n800</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>terrier</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>midway</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>microbit</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>verdex</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>highbank</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>akita</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>connex</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>collie</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='aarch64'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>64</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>spitz</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>nuri</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>kzm</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>sx1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>z2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>tosa</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>n810</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>n800</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>terrier</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>midway</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>microbit</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>verdex</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>raspi3b</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>highbank</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>akita</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>connex</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>collie</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <acpi default='on' toggle='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='cris'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>32</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='i686'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>32</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>x-remote</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>isapc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>microvm</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='kvm'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <pae/>
Apr 13 18:52:33 user nova-compute[71692]:       <nonpae/>
Apr 13 18:52:33 user nova-compute[71692]:       <acpi default='on' toggle='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:       <apic default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='m68k'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>32</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>an5206</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>q800</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>next-cube</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='microblaze'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>32</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='microblazeel'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>32</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='mips'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>32</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='16'>malta</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='mipsel'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>32</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='16'>malta</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='mips64'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>64</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='16'>malta</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>pica61</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>magnum</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='mips64el'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>64</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='16'>malta</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>pica61</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>magnum</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='16'>boston</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='ppc'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>32</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mac99</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>40p</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>taihu</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='ppc64'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>64</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2048'>powernv9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>taihu</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2048'>powernv10</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>40p</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mac99</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2048'>powernv8</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='ppc64le'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>64</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2048'>powernv9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>taihu</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2048'>powernv10</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>40p</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>mac99</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2048'>powernv8</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='riscv32'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>32</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='8'>spike</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>opentitan</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='5'>sifive_u</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>sifive_e</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='8'>virt</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='riscv64'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>64</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='8'>spike</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='5'>sifive_u</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>shakti_c</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>sifive_e</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='8'>virt</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='s390x'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>64</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='sh4'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>32</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>shix</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>r2d</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='sh4eb'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>64</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>shix</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>r2d</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='sparc'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>32</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>SS-5</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>SS-20</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>LX</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>SS-4</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>SS-10</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>Voyager</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='sparc64'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>64</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>sun4u</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>niagara</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>sun4v</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='x86_64'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>64</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>x-remote</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='1'>isapc</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>microvm</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='kvm'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <acpi default='on' toggle='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:       <apic default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='xtensa'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>32</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>sim</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>kc705</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>ml605</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>virt</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>lx200</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>lx60</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]:   <guest>
Apr 13 18:52:33 user nova-compute[71692]:     <os_type>hvm</os_type>
Apr 13 18:52:33 user nova-compute[71692]:     <arch name='xtensaeb'>
Apr 13 18:52:33 user nova-compute[71692]:       <wordsize>32</wordsize>
Apr 13 18:52:33 user nova-compute[71692]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='4'>sim</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>kc705</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>ml605</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>virt</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>lx200</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>lx60</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 13 18:52:33 user nova-compute[71692]:       <domain type='qemu'/>
Apr 13 18:52:33 user nova-compute[71692]:     </arch>
Apr 13 18:52:33 user nova-compute[71692]:     <features>
Apr 13 18:52:33 user nova-compute[71692]:       <cpuselection/>
Apr 13 18:52:33 user nova-compute[71692]:       <deviceboot/>
Apr 13 18:52:33 user nova-compute[71692]:       <disksnapshot default='on' toggle='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     </features>
Apr 13 18:52:33 user nova-compute[71692]:   </guest>
Apr 13 18:52:33 user nova-compute[71692]: </capabilities>
Apr 13 18:52:33 user nova-compute[71692]: 
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 13 18:52:33 user nova-compute[71692]: <domainCapabilities>
Apr 13 18:52:33 user nova-compute[71692]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 18:52:33 user nova-compute[71692]:   <domain>kvm</domain>
Apr 13 18:52:33 user nova-compute[71692]:   <machine>pc-q35-6.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:   <arch>i686</arch>
Apr 13 18:52:33 user nova-compute[71692]:   <vcpu max='288'/>
Apr 13 18:52:33 user nova-compute[71692]:   <iothreads supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:   <os supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:     <enum name='firmware'/>
Apr 13 18:52:33 user nova-compute[71692]:     <loader supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='type'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>rom</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>pflash</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='readonly'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>yes</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>no</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='secure'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>no</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </loader>
Apr 13 18:52:33 user nova-compute[71692]:   </os>
Apr 13 18:52:33 user nova-compute[71692]:   <cpu>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='host-passthrough' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='hostPassthroughMigratable'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>off</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='maximum' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='maximumMigratable'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>on</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>off</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='host-model' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <vendor>Intel</vendor>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ss'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='vmx'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='pcid'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='hypervisor'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='arat'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='umip'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='md-clear'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='stibp'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ssbd'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ibpb'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ibrs'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='amd-stibp'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='erms'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='lm'/>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='custom' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>qemu64</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>qemu32</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>phenom</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium3</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium2</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>n270</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>kvm64</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>kvm32</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>coreduo</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>core2duo</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>athlon</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Westmere</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Snowridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>SandyBridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Penryn</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G5</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G4</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G3</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G2</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G1</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Nehalem</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>IvyBridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Icelake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-Rome</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-Milan</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Dhyana</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cooperlake</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Conroe</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>486</model>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:   </cpu>
Apr 13 18:52:33 user nova-compute[71692]:   <memoryBacking supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:     <enum name='sourceType'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>file</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>anonymous</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>memfd</value>
Apr 13 18:52:33 user nova-compute[71692]:     </enum>
Apr 13 18:52:33 user nova-compute[71692]:   </memoryBacking>
Apr 13 18:52:33 user nova-compute[71692]:   <devices>
Apr 13 18:52:33 user nova-compute[71692]:     <disk supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='diskDevice'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>disk</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>cdrom</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>floppy</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>lun</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='bus'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>fdc</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>scsi</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>usb</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>sata</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-non-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </disk>
Apr 13 18:52:33 user nova-compute[71692]:     <graphics supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='type'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>sdl</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vnc</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>spice</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>egl-headless</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </graphics>
Apr 13 18:52:33 user nova-compute[71692]:     <video supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='modelType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vga</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>cirrus</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vmvga</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>qxl</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>none</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>bochs</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>ramfb</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </video>
Apr 13 18:52:33 user nova-compute[71692]:     <hostdev supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='mode'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>subsystem</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='startupPolicy'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>default</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>mandatory</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>requisite</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>optional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='subsysType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>usb</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>pci</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>scsi</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='capsType'/>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='pciBackend'/>
Apr 13 18:52:33 user nova-compute[71692]:     </hostdev>
Apr 13 18:52:33 user nova-compute[71692]:     <rng supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-non-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='backendModel'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>random</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>egd</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>builtin</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </rng>
Apr 13 18:52:33 user nova-compute[71692]:     <filesystem supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='driverType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>path</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>handle</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtiofs</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </filesystem>
Apr 13 18:52:33 user nova-compute[71692]:     <tpm supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>tpm-tis</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>tpm-crb</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='backendModel'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>passthrough</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>emulator</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </tpm>
Apr 13 18:52:33 user nova-compute[71692]:   </devices>
Apr 13 18:52:33 user nova-compute[71692]:   <features>
Apr 13 18:52:33 user nova-compute[71692]:     <gic supported='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     <vmcoreinfo supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <genid supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <backingStoreInput supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <backup supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <sev supported='no'/>
Apr 13 18:52:33 user nova-compute[71692]:   </features>
Apr 13 18:52:33 user nova-compute[71692]: </domainCapabilities>
Apr 13 18:52:33 user nova-compute[71692]:  {{(pid=71692) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 13 18:52:33 user nova-compute[71692]: <domainCapabilities>
Apr 13 18:52:33 user nova-compute[71692]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 18:52:33 user nova-compute[71692]:   <domain>kvm</domain>
Apr 13 18:52:33 user nova-compute[71692]:   <machine>pc-q35-jammy</machine>
Apr 13 18:52:33 user nova-compute[71692]:   <arch>i686</arch>
Apr 13 18:52:33 user nova-compute[71692]:   <vcpu max='288'/>
Apr 13 18:52:33 user nova-compute[71692]:   <iothreads supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:   <os supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:     <enum name='firmware'/>
Apr 13 18:52:33 user nova-compute[71692]:     <loader supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='type'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>rom</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>pflash</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='readonly'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>yes</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>no</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='secure'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>no</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </loader>
Apr 13 18:52:33 user nova-compute[71692]:   </os>
Apr 13 18:52:33 user nova-compute[71692]:   <cpu>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='host-passthrough' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='hostPassthroughMigratable'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>off</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='maximum' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='maximumMigratable'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>on</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>off</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='host-model' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <vendor>Intel</vendor>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ss'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='vmx'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='pcid'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='hypervisor'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='arat'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='umip'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='md-clear'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='stibp'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ssbd'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ibpb'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ibrs'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='amd-stibp'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='erms'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='lm'/>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='custom' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>qemu64</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>qemu32</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>phenom</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium3</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium2</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>n270</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>kvm64</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>kvm32</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>coreduo</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>core2duo</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>athlon</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Westmere</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Snowridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>SandyBridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Penryn</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G5</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G4</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G3</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G2</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G1</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Nehalem</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>IvyBridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Icelake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-Rome</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-Milan</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Dhyana</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cooperlake</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Conroe</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>486</model>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:   </cpu>
Apr 13 18:52:33 user nova-compute[71692]:   <memoryBacking supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:     <enum name='sourceType'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>file</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>anonymous</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>memfd</value>
Apr 13 18:52:33 user nova-compute[71692]:     </enum>
Apr 13 18:52:33 user nova-compute[71692]:   </memoryBacking>
Apr 13 18:52:33 user nova-compute[71692]:   <devices>
Apr 13 18:52:33 user nova-compute[71692]:     <disk supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='diskDevice'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>disk</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>cdrom</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>floppy</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>lun</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='bus'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>fdc</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>scsi</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>usb</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>sata</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-non-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </disk>
Apr 13 18:52:33 user nova-compute[71692]:     <graphics supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='type'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>sdl</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vnc</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>spice</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>egl-headless</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </graphics>
Apr 13 18:52:33 user nova-compute[71692]:     <video supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='modelType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vga</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>cirrus</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vmvga</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>qxl</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>none</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>bochs</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>ramfb</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </video>
Apr 13 18:52:33 user nova-compute[71692]:     <hostdev supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='mode'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>subsystem</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='startupPolicy'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>default</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>mandatory</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>requisite</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>optional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='subsysType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>usb</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>pci</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>scsi</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='capsType'/>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='pciBackend'/>
Apr 13 18:52:33 user nova-compute[71692]:     </hostdev>
Apr 13 18:52:33 user nova-compute[71692]:     <rng supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-non-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='backendModel'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>random</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>egd</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>builtin</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </rng>
Apr 13 18:52:33 user nova-compute[71692]:     <filesystem supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='driverType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>path</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>handle</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtiofs</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </filesystem>
Apr 13 18:52:33 user nova-compute[71692]:     <tpm supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>tpm-tis</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>tpm-crb</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='backendModel'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>passthrough</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>emulator</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </tpm>
Apr 13 18:52:33 user nova-compute[71692]:   </devices>
Apr 13 18:52:33 user nova-compute[71692]:   <features>
Apr 13 18:52:33 user nova-compute[71692]:     <gic supported='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     <vmcoreinfo supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <genid supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <backingStoreInput supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <backup supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <sev supported='no'/>
Apr 13 18:52:33 user nova-compute[71692]:   </features>
Apr 13 18:52:33 user nova-compute[71692]: </domainCapabilities>
Apr 13 18:52:33 user nova-compute[71692]:  {{(pid=71692) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 13 18:52:33 user nova-compute[71692]: <domainCapabilities>
Apr 13 18:52:33 user nova-compute[71692]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 18:52:33 user nova-compute[71692]:   <domain>kvm</domain>
Apr 13 18:52:33 user nova-compute[71692]:   <machine>pc-i440fx-6.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:   <arch>i686</arch>
Apr 13 18:52:33 user nova-compute[71692]:   <vcpu max='255'/>
Apr 13 18:52:33 user nova-compute[71692]:   <iothreads supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:   <os supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:     <enum name='firmware'/>
Apr 13 18:52:33 user nova-compute[71692]:     <loader supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='type'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>rom</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>pflash</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='readonly'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>yes</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>no</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='secure'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>no</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </loader>
Apr 13 18:52:33 user nova-compute[71692]:   </os>
Apr 13 18:52:33 user nova-compute[71692]:   <cpu>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='host-passthrough' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='hostPassthroughMigratable'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>off</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='maximum' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='maximumMigratable'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>on</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>off</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='host-model' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <vendor>Intel</vendor>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ss'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='vmx'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='pcid'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='hypervisor'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='arat'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='umip'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='md-clear'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='stibp'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ssbd'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ibpb'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ibrs'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='amd-stibp'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='erms'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='lm'/>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='custom' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>qemu64</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>qemu32</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>phenom</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium3</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium2</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>n270</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>kvm64</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>kvm32</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>coreduo</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>core2duo</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>athlon</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Westmere</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Snowridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>SandyBridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Penryn</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G5</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G4</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G3</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G2</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G1</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Nehalem</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>IvyBridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Icelake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-Rome</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-Milan</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Dhyana</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cooperlake</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Conroe</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>486</model>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:   </cpu>
Apr 13 18:52:33 user nova-compute[71692]:   <memoryBacking supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:     <enum name='sourceType'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>file</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>anonymous</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>memfd</value>
Apr 13 18:52:33 user nova-compute[71692]:     </enum>
Apr 13 18:52:33 user nova-compute[71692]:   </memoryBacking>
Apr 13 18:52:33 user nova-compute[71692]:   <devices>
Apr 13 18:52:33 user nova-compute[71692]:     <disk supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='diskDevice'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>disk</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>cdrom</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>floppy</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>lun</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='bus'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>ide</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>fdc</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>scsi</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>usb</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>sata</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-non-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </disk>
Apr 13 18:52:33 user nova-compute[71692]:     <graphics supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='type'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>sdl</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vnc</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>spice</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>egl-headless</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </graphics>
Apr 13 18:52:33 user nova-compute[71692]:     <video supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='modelType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vga</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>cirrus</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vmvga</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>qxl</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>none</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>bochs</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>ramfb</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </video>
Apr 13 18:52:33 user nova-compute[71692]:     <hostdev supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='mode'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>subsystem</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='startupPolicy'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>default</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>mandatory</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>requisite</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>optional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='subsysType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>usb</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>pci</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>scsi</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='capsType'/>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='pciBackend'/>
Apr 13 18:52:33 user nova-compute[71692]:     </hostdev>
Apr 13 18:52:33 user nova-compute[71692]:     <rng supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-non-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='backendModel'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>random</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>egd</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>builtin</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </rng>
Apr 13 18:52:33 user nova-compute[71692]:     <filesystem supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='driverType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>path</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>handle</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtiofs</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </filesystem>
Apr 13 18:52:33 user nova-compute[71692]:     <tpm supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>tpm-tis</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>tpm-crb</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='backendModel'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>passthrough</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>emulator</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </tpm>
Apr 13 18:52:33 user nova-compute[71692]:   </devices>
Apr 13 18:52:33 user nova-compute[71692]:   <features>
Apr 13 18:52:33 user nova-compute[71692]:     <gic supported='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     <vmcoreinfo supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <genid supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <backingStoreInput supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <backup supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <sev supported='no'/>
Apr 13 18:52:33 user nova-compute[71692]:   </features>
Apr 13 18:52:33 user nova-compute[71692]: </domainCapabilities>
Apr 13 18:52:33 user nova-compute[71692]:  {{(pid=71692) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 13 18:52:33 user nova-compute[71692]: <domainCapabilities>
Apr 13 18:52:33 user nova-compute[71692]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 18:52:33 user nova-compute[71692]:   <domain>kvm</domain>
Apr 13 18:52:33 user nova-compute[71692]:   <machine>pc-i440fx-jammy</machine>
Apr 13 18:52:33 user nova-compute[71692]:   <arch>i686</arch>
Apr 13 18:52:33 user nova-compute[71692]:   <vcpu max='255'/>
Apr 13 18:52:33 user nova-compute[71692]:   <iothreads supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:   <os supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:     <enum name='firmware'/>
Apr 13 18:52:33 user nova-compute[71692]:     <loader supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='type'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>rom</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>pflash</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='readonly'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>yes</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>no</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='secure'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>no</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </loader>
Apr 13 18:52:33 user nova-compute[71692]:   </os>
Apr 13 18:52:33 user nova-compute[71692]:   <cpu>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='host-passthrough' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='hostPassthroughMigratable'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>off</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='maximum' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='maximumMigratable'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>on</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>off</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='host-model' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <vendor>Intel</vendor>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ss'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='vmx'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='pcid'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='hypervisor'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='arat'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='umip'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='md-clear'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='stibp'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ssbd'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ibpb'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ibrs'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='amd-stibp'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='erms'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='lm'/>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='custom' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>qemu64</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>qemu32</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>phenom</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium3</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium2</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>n270</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>kvm64</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>kvm32</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>coreduo</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>core2duo</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>athlon</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Westmere</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Snowridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>SandyBridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Penryn</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G5</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G4</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G3</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G2</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G1</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Nehalem</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>IvyBridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Icelake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-Rome</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-Milan</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Dhyana</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cooperlake</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Conroe</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>486</model>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:   </cpu>
Apr 13 18:52:33 user nova-compute[71692]:   <memoryBacking supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:     <enum name='sourceType'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>file</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>anonymous</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>memfd</value>
Apr 13 18:52:33 user nova-compute[71692]:     </enum>
Apr 13 18:52:33 user nova-compute[71692]:   </memoryBacking>
Apr 13 18:52:33 user nova-compute[71692]:   <devices>
Apr 13 18:52:33 user nova-compute[71692]:     <disk supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='diskDevice'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>disk</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>cdrom</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>floppy</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>lun</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='bus'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>ide</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>fdc</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>scsi</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>usb</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>sata</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-non-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </disk>
Apr 13 18:52:33 user nova-compute[71692]:     <graphics supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='type'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>sdl</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vnc</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>spice</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>egl-headless</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </graphics>
Apr 13 18:52:33 user nova-compute[71692]:     <video supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='modelType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vga</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>cirrus</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vmvga</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>qxl</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>none</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>bochs</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>ramfb</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </video>
Apr 13 18:52:33 user nova-compute[71692]:     <hostdev supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='mode'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>subsystem</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='startupPolicy'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>default</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>mandatory</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>requisite</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>optional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='subsysType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>usb</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>pci</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>scsi</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='capsType'/>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='pciBackend'/>
Apr 13 18:52:33 user nova-compute[71692]:     </hostdev>
Apr 13 18:52:33 user nova-compute[71692]:     <rng supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-non-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='backendModel'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>random</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>egd</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>builtin</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </rng>
Apr 13 18:52:33 user nova-compute[71692]:     <filesystem supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='driverType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>path</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>handle</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtiofs</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </filesystem>
Apr 13 18:52:33 user nova-compute[71692]:     <tpm supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>tpm-tis</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>tpm-crb</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='backendModel'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>passthrough</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>emulator</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </tpm>
Apr 13 18:52:33 user nova-compute[71692]:   </devices>
Apr 13 18:52:33 user nova-compute[71692]:   <features>
Apr 13 18:52:33 user nova-compute[71692]:     <gic supported='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     <vmcoreinfo supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <genid supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <backingStoreInput supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <backup supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <sev supported='no'/>
Apr 13 18:52:33 user nova-compute[71692]:   </features>
Apr 13 18:52:33 user nova-compute[71692]: </domainCapabilities>
Apr 13 18:52:33 user nova-compute[71692]:  {{(pid=71692) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 13 18:52:33 user nova-compute[71692]: <domainCapabilities>
Apr 13 18:52:33 user nova-compute[71692]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 18:52:33 user nova-compute[71692]:   <domain>kvm</domain>
Apr 13 18:52:33 user nova-compute[71692]:   <machine>pc-q35-6.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:   <arch>x86_64</arch>
Apr 13 18:52:33 user nova-compute[71692]:   <vcpu max='288'/>
Apr 13 18:52:33 user nova-compute[71692]:   <iothreads supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:   <os supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:     <enum name='firmware'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>efi</value>
Apr 13 18:52:33 user nova-compute[71692]:     </enum>
Apr 13 18:52:33 user nova-compute[71692]:     <loader supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='type'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>rom</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>pflash</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='readonly'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>yes</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>no</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='secure'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>yes</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>no</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </loader>
Apr 13 18:52:33 user nova-compute[71692]:   </os>
Apr 13 18:52:33 user nova-compute[71692]:   <cpu>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='host-passthrough' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='hostPassthroughMigratable'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>on</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>off</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='maximum' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='maximumMigratable'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>on</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>off</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='host-model' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <vendor>Intel</vendor>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ss'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='vmx'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='pcid'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='hypervisor'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='arat'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='umip'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='md-clear'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='stibp'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ssbd'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='invtsc'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ibpb'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ibrs'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='amd-stibp'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='rsba'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='erms'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='custom' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>qemu64</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>qemu32</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>phenom</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium3</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium2</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>n270</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>kvm64</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>kvm32</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>coreduo</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>core2duo</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>athlon</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Westmere</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Snowridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>SandyBridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Penryn</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G5</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G4</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G3</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G2</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Opteron_G1</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Nehalem</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>IvyBridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Icelake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-Rome</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-Milan</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Dhyana</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cooperlake</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Conroe</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>486</model>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:   </cpu>
Apr 13 18:52:33 user nova-compute[71692]:   <memoryBacking supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:     <enum name='sourceType'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>file</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>anonymous</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>memfd</value>
Apr 13 18:52:33 user nova-compute[71692]:     </enum>
Apr 13 18:52:33 user nova-compute[71692]:   </memoryBacking>
Apr 13 18:52:33 user nova-compute[71692]:   <devices>
Apr 13 18:52:33 user nova-compute[71692]:     <disk supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='diskDevice'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>disk</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>cdrom</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>floppy</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>lun</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='bus'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>fdc</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>scsi</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>usb</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>sata</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-non-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </disk>
Apr 13 18:52:33 user nova-compute[71692]:     <graphics supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='type'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>sdl</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vnc</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>spice</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>egl-headless</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </graphics>
Apr 13 18:52:33 user nova-compute[71692]:     <video supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='modelType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vga</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>cirrus</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vmvga</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>qxl</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>none</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>bochs</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>ramfb</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </video>
Apr 13 18:52:33 user nova-compute[71692]:     <hostdev supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='mode'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>subsystem</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='startupPolicy'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>default</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>mandatory</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>requisite</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>optional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='subsysType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>usb</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>pci</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>scsi</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='capsType'/>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='pciBackend'/>
Apr 13 18:52:33 user nova-compute[71692]:     </hostdev>
Apr 13 18:52:33 user nova-compute[71692]:     <rng supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-non-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='backendModel'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>random</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>egd</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>builtin</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </rng>
Apr 13 18:52:33 user nova-compute[71692]:     <filesystem supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='driverType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>path</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>handle</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtiofs</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </filesystem>
Apr 13 18:52:33 user nova-compute[71692]:     <tpm supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>tpm-tis</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>tpm-crb</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='backendModel'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>passthrough</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>emulator</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </tpm>
Apr 13 18:52:33 user nova-compute[71692]:   </devices>
Apr 13 18:52:33 user nova-compute[71692]:   <features>
Apr 13 18:52:33 user nova-compute[71692]:     <gic supported='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     <vmcoreinfo supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <genid supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <backingStoreInput supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <backup supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <sev supported='no'/>
Apr 13 18:52:33 user nova-compute[71692]:   </features>
Apr 13 18:52:33 user nova-compute[71692]: </domainCapabilities>
Apr 13 18:52:33 user nova-compute[71692]:  {{(pid=71692) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 13 18:52:33 user nova-compute[71692]: <domainCapabilities>
Apr 13 18:52:33 user nova-compute[71692]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 18:52:33 user nova-compute[71692]:   <domain>kvm</domain>
Apr 13 18:52:33 user nova-compute[71692]:   <machine>pc-q35-jammy</machine>
Apr 13 18:52:33 user nova-compute[71692]:   <arch>x86_64</arch>
Apr 13 18:52:33 user nova-compute[71692]:   <vcpu max='288'/>
Apr 13 18:52:33 user nova-compute[71692]:   <iothreads supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:   <os supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:     <enum name='firmware'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>efi</value>
Apr 13 18:52:33 user nova-compute[71692]:     </enum>
Apr 13 18:52:33 user nova-compute[71692]:     <loader supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='type'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>rom</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>pflash</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='readonly'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>yes</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>no</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='secure'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>yes</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>no</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </loader>
Apr 13 18:52:33 user nova-compute[71692]:   </os>
Apr 13 18:52:33 user nova-compute[71692]:   <cpu>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='host-passthrough' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='hostPassthroughMigratable'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>on</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>off</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='maximum' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='maximumMigratable'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>on</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>off</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='host-model' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <vendor>Intel</vendor>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ss'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='vmx'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='pcid'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='hypervisor'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='arat'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='umip'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='md-clear'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='stibp'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ssbd'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='invtsc'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ibpb'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ibrs'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='amd-stibp'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='rsba'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='erms'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='custom' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>qemu64</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>qemu32</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>phenom</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium3</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium2</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>n270</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>kvm64</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>kvm32</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>coreduo</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>core2duo</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>athlon</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Westmere</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Snowridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>SandyBridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Penryn</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G5</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G4</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G3</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G2</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Opteron_G1</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Nehalem</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>IvyBridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Icelake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-Rome</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-Milan</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Dhyana</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cooperlake</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Conroe</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>486</model>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:   </cpu>
Apr 13 18:52:33 user nova-compute[71692]:   <memoryBacking supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:     <enum name='sourceType'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>file</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>anonymous</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>memfd</value>
Apr 13 18:52:33 user nova-compute[71692]:     </enum>
Apr 13 18:52:33 user nova-compute[71692]:   </memoryBacking>
Apr 13 18:52:33 user nova-compute[71692]:   <devices>
Apr 13 18:52:33 user nova-compute[71692]:     <disk supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='diskDevice'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>disk</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>cdrom</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>floppy</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>lun</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='bus'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>fdc</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>scsi</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>usb</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>sata</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-non-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </disk>
Apr 13 18:52:33 user nova-compute[71692]:     <graphics supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='type'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>sdl</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vnc</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>spice</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>egl-headless</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </graphics>
Apr 13 18:52:33 user nova-compute[71692]:     <video supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='modelType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vga</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>cirrus</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vmvga</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>qxl</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>none</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>bochs</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>ramfb</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </video>
Apr 13 18:52:33 user nova-compute[71692]:     <hostdev supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='mode'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>subsystem</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='startupPolicy'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>default</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>mandatory</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>requisite</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>optional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='subsysType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>usb</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>pci</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>scsi</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='capsType'/>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='pciBackend'/>
Apr 13 18:52:33 user nova-compute[71692]:     </hostdev>
Apr 13 18:52:33 user nova-compute[71692]:     <rng supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-non-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='backendModel'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>random</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>egd</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>builtin</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </rng>
Apr 13 18:52:33 user nova-compute[71692]:     <filesystem supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='driverType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>path</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>handle</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtiofs</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </filesystem>
Apr 13 18:52:33 user nova-compute[71692]:     <tpm supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>tpm-tis</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>tpm-crb</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='backendModel'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>passthrough</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>emulator</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </tpm>
Apr 13 18:52:33 user nova-compute[71692]:   </devices>
Apr 13 18:52:33 user nova-compute[71692]:   <features>
Apr 13 18:52:33 user nova-compute[71692]:     <gic supported='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     <vmcoreinfo supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <genid supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <backingStoreInput supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <backup supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <sev supported='no'/>
Apr 13 18:52:33 user nova-compute[71692]:   </features>
Apr 13 18:52:33 user nova-compute[71692]: </domainCapabilities>
Apr 13 18:52:33 user nova-compute[71692]:  {{(pid=71692) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 13 18:52:33 user nova-compute[71692]: <domainCapabilities>
Apr 13 18:52:33 user nova-compute[71692]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 18:52:33 user nova-compute[71692]:   <domain>kvm</domain>
Apr 13 18:52:33 user nova-compute[71692]:   <machine>pc-i440fx-6.2</machine>
Apr 13 18:52:33 user nova-compute[71692]:   <arch>x86_64</arch>
Apr 13 18:52:33 user nova-compute[71692]:   <vcpu max='255'/>
Apr 13 18:52:33 user nova-compute[71692]:   <iothreads supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:   <os supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:     <enum name='firmware'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>efi</value>
Apr 13 18:52:33 user nova-compute[71692]:     </enum>
Apr 13 18:52:33 user nova-compute[71692]:     <loader supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='type'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>rom</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>pflash</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='readonly'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>yes</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>no</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='secure'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>no</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </loader>
Apr 13 18:52:33 user nova-compute[71692]:   </os>
Apr 13 18:52:33 user nova-compute[71692]:   <cpu>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='host-passthrough' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='hostPassthroughMigratable'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>on</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>off</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='maximum' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='maximumMigratable'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>on</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>off</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='host-model' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <vendor>Intel</vendor>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ss'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='vmx'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='pcid'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='hypervisor'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='arat'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='umip'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='md-clear'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='stibp'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ssbd'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='invtsc'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ibpb'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ibrs'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='amd-stibp'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='rsba'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='erms'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='custom' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>qemu64</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>qemu32</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>phenom</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium3</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium2</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>n270</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>kvm64</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>kvm32</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>coreduo</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>core2duo</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>athlon</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Westmere</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Snowridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>SandyBridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Penryn</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G5</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G4</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G3</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G2</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Opteron_G1</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Nehalem</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>IvyBridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Icelake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-Rome</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-Milan</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Dhyana</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cooperlake</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Conroe</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>486</model>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:   </cpu>
Apr 13 18:52:33 user nova-compute[71692]:   <memoryBacking supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:     <enum name='sourceType'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>file</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>anonymous</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>memfd</value>
Apr 13 18:52:33 user nova-compute[71692]:     </enum>
Apr 13 18:52:33 user nova-compute[71692]:   </memoryBacking>
Apr 13 18:52:33 user nova-compute[71692]:   <devices>
Apr 13 18:52:33 user nova-compute[71692]:     <disk supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='diskDevice'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>disk</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>cdrom</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>floppy</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>lun</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='bus'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>ide</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>fdc</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>scsi</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>usb</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>sata</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-non-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </disk>
Apr 13 18:52:33 user nova-compute[71692]:     <graphics supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='type'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>sdl</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vnc</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>spice</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>egl-headless</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </graphics>
Apr 13 18:52:33 user nova-compute[71692]:     <video supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='modelType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vga</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>cirrus</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vmvga</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>qxl</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>none</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>bochs</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>ramfb</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </video>
Apr 13 18:52:33 user nova-compute[71692]:     <hostdev supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='mode'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>subsystem</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='startupPolicy'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>default</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>mandatory</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>requisite</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>optional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='subsysType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>usb</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>pci</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>scsi</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='capsType'/>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='pciBackend'/>
Apr 13 18:52:33 user nova-compute[71692]:     </hostdev>
Apr 13 18:52:33 user nova-compute[71692]:     <rng supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-non-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='backendModel'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>random</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>egd</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>builtin</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </rng>
Apr 13 18:52:33 user nova-compute[71692]:     <filesystem supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='driverType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>path</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>handle</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtiofs</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </filesystem>
Apr 13 18:52:33 user nova-compute[71692]:     <tpm supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>tpm-tis</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>tpm-crb</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='backendModel'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>passthrough</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>emulator</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </tpm>
Apr 13 18:52:33 user nova-compute[71692]:   </devices>
Apr 13 18:52:33 user nova-compute[71692]:   <features>
Apr 13 18:52:33 user nova-compute[71692]:     <gic supported='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     <vmcoreinfo supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <genid supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <backingStoreInput supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <backup supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <sev supported='no'/>
Apr 13 18:52:33 user nova-compute[71692]:   </features>
Apr 13 18:52:33 user nova-compute[71692]: </domainCapabilities>
Apr 13 18:52:33 user nova-compute[71692]:  {{(pid=71692) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 13 18:52:33 user nova-compute[71692]: <domainCapabilities>
Apr 13 18:52:33 user nova-compute[71692]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 18:52:33 user nova-compute[71692]:   <domain>kvm</domain>
Apr 13 18:52:33 user nova-compute[71692]:   <machine>pc-i440fx-jammy</machine>
Apr 13 18:52:33 user nova-compute[71692]:   <arch>x86_64</arch>
Apr 13 18:52:33 user nova-compute[71692]:   <vcpu max='255'/>
Apr 13 18:52:33 user nova-compute[71692]:   <iothreads supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:   <os supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:     <enum name='firmware'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>efi</value>
Apr 13 18:52:33 user nova-compute[71692]:     </enum>
Apr 13 18:52:33 user nova-compute[71692]:     <loader supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='type'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>rom</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>pflash</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='readonly'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>yes</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>no</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='secure'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>no</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </loader>
Apr 13 18:52:33 user nova-compute[71692]:   </os>
Apr 13 18:52:33 user nova-compute[71692]:   <cpu>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='host-passthrough' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='hostPassthroughMigratable'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>on</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>off</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='maximum' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='maximumMigratable'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>on</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>off</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='host-model' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <vendor>Intel</vendor>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ss'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='vmx'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='pcid'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='hypervisor'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='arat'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='umip'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='md-clear'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='stibp'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ssbd'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='invtsc'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ibpb'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='ibrs'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='amd-stibp'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='rsba'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='erms'/>
Apr 13 18:52:33 user nova-compute[71692]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:     <mode name='custom' supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>qemu64</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>qemu32</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>phenom</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium3</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium2</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>pentium</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>n270</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>kvm64</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>kvm32</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>coreduo</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>core2duo</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>athlon</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Westmere</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Snowridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Skylake-Client</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>SandyBridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Penryn</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G5</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G4</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G3</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Opteron_G2</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Opteron_G1</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Nehalem</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>IvyBridge</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Icelake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Haswell</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-Rome</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-Milan</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>EPYC</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Dhyana</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cooperlake</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>Conroe</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='no'>Broadwell</model>
Apr 13 18:52:33 user nova-compute[71692]:       <model usable='yes'>486</model>
Apr 13 18:52:33 user nova-compute[71692]:     </mode>
Apr 13 18:52:33 user nova-compute[71692]:   </cpu>
Apr 13 18:52:33 user nova-compute[71692]:   <memoryBacking supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:     <enum name='sourceType'>
Apr 13 18:52:33 user nova-compute[71692]:       <value>file</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>anonymous</value>
Apr 13 18:52:33 user nova-compute[71692]:       <value>memfd</value>
Apr 13 18:52:33 user nova-compute[71692]:     </enum>
Apr 13 18:52:33 user nova-compute[71692]:   </memoryBacking>
Apr 13 18:52:33 user nova-compute[71692]:   <devices>
Apr 13 18:52:33 user nova-compute[71692]:     <disk supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='diskDevice'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>disk</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>cdrom</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>floppy</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>lun</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='bus'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>ide</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>fdc</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>scsi</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>usb</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>sata</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-non-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </disk>
Apr 13 18:52:33 user nova-compute[71692]:     <graphics supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='type'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>sdl</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vnc</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>spice</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>egl-headless</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </graphics>
Apr 13 18:52:33 user nova-compute[71692]:     <video supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='modelType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vga</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>cirrus</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>vmvga</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>qxl</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>none</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>bochs</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>ramfb</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </video>
Apr 13 18:52:33 user nova-compute[71692]:     <hostdev supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='mode'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>subsystem</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='startupPolicy'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>default</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>mandatory</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>requisite</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>optional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='subsysType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>usb</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>pci</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>scsi</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='capsType'/>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='pciBackend'/>
Apr 13 18:52:33 user nova-compute[71692]:     </hostdev>
Apr 13 18:52:33 user nova-compute[71692]:     <rng supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtio-non-transitional</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='backendModel'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>random</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>egd</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>builtin</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </rng>
Apr 13 18:52:33 user nova-compute[71692]:     <filesystem supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='driverType'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>path</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>handle</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>virtiofs</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </filesystem>
Apr 13 18:52:33 user nova-compute[71692]:     <tpm supported='yes'>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='model'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>tpm-tis</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>tpm-crb</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:       <enum name='backendModel'>
Apr 13 18:52:33 user nova-compute[71692]:         <value>passthrough</value>
Apr 13 18:52:33 user nova-compute[71692]:         <value>emulator</value>
Apr 13 18:52:33 user nova-compute[71692]:       </enum>
Apr 13 18:52:33 user nova-compute[71692]:     </tpm>
Apr 13 18:52:33 user nova-compute[71692]:   </devices>
Apr 13 18:52:33 user nova-compute[71692]:   <features>
Apr 13 18:52:33 user nova-compute[71692]:     <gic supported='no'/>
Apr 13 18:52:33 user nova-compute[71692]:     <vmcoreinfo supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <genid supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <backingStoreInput supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <backup supported='yes'/>
Apr 13 18:52:33 user nova-compute[71692]:     <sev supported='no'/>
Apr 13 18:52:33 user nova-compute[71692]:   </features>
Apr 13 18:52:33 user nova-compute[71692]: </domainCapabilities>
Apr 13 18:52:33 user nova-compute[71692]:  {{(pid=71692) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71692) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71692) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Checking secure boot support for host arch (x86_64) {{(pid=71692) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 13 18:52:33 user nova-compute[71692]: INFO nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Secure Boot support detected
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] cpu compare xml: <cpu match="exact">
Apr 13 18:52:33 user nova-compute[71692]:   <model>Nehalem</model>
Apr 13 18:52:33 user nova-compute[71692]: </cpu>
Apr 13 18:52:33 user nova-compute[71692]:  {{(pid=71692) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 13 18:52:33 user nova-compute[71692]: INFO nova.virt.node [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Generated node identity 6ec8625c-38f9-4b14-a833-1c01964497f1
Apr 13 18:52:33 user nova-compute[71692]: INFO nova.virt.node [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Wrote node identity 6ec8625c-38f9-4b14-a833-1c01964497f1 to /opt/stack/data/nova/compute_id
Apr 13 18:52:33 user nova-compute[71692]: WARNING nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Compute nodes ['6ec8625c-38f9-4b14-a833-1c01964497f1'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 13 18:52:33 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 13 18:52:33 user nova-compute[71692]: WARNING nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 13 18:52:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:52:33 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:52:34 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:52:34 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:52:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Hypervisor/Node resource view: name=user free_ram=10904MB free_disk=26.90652084350586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:52:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:52:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:52:34 user nova-compute[71692]: WARNING nova.compute.resource_tracker [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] No compute node record for user:6ec8625c-38f9-4b14-a833-1c01964497f1: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 6ec8625c-38f9-4b14-a833-1c01964497f1 could not be found.
Apr 13 18:52:34 user nova-compute[71692]: INFO nova.compute.resource_tracker [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Compute node record created for user:user with uuid: 6ec8625c-38f9-4b14-a833-1c01964497f1
Apr 13 18:52:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:52:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:52:34 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [req-1f508bd3-bfdd-4117-95fb-be63ecaf1584] Created resource provider record via placement API for resource provider with UUID 6ec8625c-38f9-4b14-a833-1c01964497f1 and name user.
Apr 13 18:52:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71692) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 13 18:52:34 user nova-compute[71692]: INFO nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] kernel doesn't support AMD SEV
Apr 13 18:52:34 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Updating inventory in ProviderTree for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 18:52:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:52:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Libvirt baseline CPU <cpu>
Apr 13 18:52:34 user nova-compute[71692]:   <arch>x86_64</arch>
Apr 13 18:52:34 user nova-compute[71692]:   <model>Nehalem</model>
Apr 13 18:52:34 user nova-compute[71692]:   <vendor>Intel</vendor>
Apr 13 18:52:34 user nova-compute[71692]:   <topology sockets="6" cores="1" threads="1"/>
Apr 13 18:52:34 user nova-compute[71692]: </cpu>
Apr 13 18:52:34 user nova-compute[71692]:  {{(pid=71692) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 13 18:52:34 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Updated inventory for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 13 18:52:34 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Updating resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1 generation from 0 to 1 during operation: update_inventory {{(pid=71692) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 13 18:52:34 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Updating inventory in ProviderTree for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 18:52:34 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Updating resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1 generation from 1 to 2 during operation: update_traits {{(pid=71692) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 13 18:52:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:52:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.597s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:52:34 user nova-compute[71692]: DEBUG nova.service [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Creating RPC server for service compute {{(pid=71692) start /opt/stack/nova/nova/service.py:182}}
Apr 13 18:52:34 user nova-compute[71692]: DEBUG nova.service [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Join ServiceGroup membership for this service compute {{(pid=71692) start /opt/stack/nova/nova/service.py:199}}
Apr 13 18:52:34 user nova-compute[71692]: DEBUG nova.servicegroup.drivers.db [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71692) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 13 18:53:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:53:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Didn't find any instances for network info cache update. {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:53:25 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:53:25 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:53:25 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=10218MB free_disk=26.820114135742188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:53:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.102s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:54:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:54:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:54:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:54:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:54:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:54:26 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:54:26 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Didn't find any instances for network info cache update. {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:54:27 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:54:27 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:54:27 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=10191MB free_disk=26.86397933959961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:54:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:55:26 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:55:26 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:55:26 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:55:26 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:55:27 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:55:27 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:55:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:55:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:55:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:55:27 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:55:27 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:55:27 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:55:27 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=10214MB free_disk=26.642230987548828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:55:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:55:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:55:27 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:55:27 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:55:27 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:55:27 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:55:27 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:55:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:55:28 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:55:28 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:55:28 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:55:28 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Didn't find any instances for network info cache update. {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 18:55:28 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:55:28 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:55:28 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:56:27 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:56:27 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:56:27 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:56:27 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:56:28 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:56:28 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:56:28 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:56:29 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:56:29 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:56:29 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:56:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:29 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:56:29 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:56:29 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:56:29 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=9408MB free_disk=26.664382934570312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:56:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:29 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:56:29 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:56:29 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:56:29 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:56:29 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:56:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.119s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:30 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:56:30 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:56:30 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:56:30 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Didn't find any instances for network info cache update. {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 18:56:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "b7d32500-da20-4a99-af04-5f422ac6ba0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:34 user nova-compute[71692]: DEBUG nova.compute.manager [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:56:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:34 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:56:34 user nova-compute[71692]: INFO nova.compute.claims [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Claim successful on node user
Apr 13 18:56:34 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:56:35 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:56:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:56:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:56:35 user nova-compute[71692]: DEBUG nova.network.neutron [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:56:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:56:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:56:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:56:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:56:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Creating image(s)
Apr 13 18:56:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "/opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "/opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31.part --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:36 user nova-compute[71692]: DEBUG nova.policy [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1424be1648d4e8081f6a679b1407d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b577e81535534db29f5c81837949e958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:56:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31.part --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:36 user nova-compute[71692]: DEBUG nova.virt.images [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] e5467a4f-b219-48a2-9412-0a7e7ac851c3 was qcow2, converting to raw {{(pid=71692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 18:56:36 user nova-compute[71692]: DEBUG nova.privsep.utils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 18:56:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31.part /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31.converted {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31.part /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31.converted" returned: 0 in 0.181s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31.converted --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31.converted --force-share --output=json" returned: 0 in 0.160s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.112s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:36 user nova-compute[71692]: INFO oslo.privsep.daemon [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5zqhfl5a/privsep.sock']
Apr 13 18:56:36 user sudo[80689]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5zqhfl5a/privsep.sock
Apr 13 18:56:36 user sudo[80689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 18:56:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:36 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:56:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:37 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:56:37 user nova-compute[71692]: INFO nova.compute.claims [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Claim successful on node user
Apr 13 18:56:37 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:56:37 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:56:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:56:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:56:37 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:56:37 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:56:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:56:37 user nova-compute[71692]: DEBUG nova.policy [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba70f34af8664dc89fd9851d00d5b96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b52d6508154a918a13b31712b32796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:56:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:56:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:56:37 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Creating image(s)
Apr 13 18:56:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "/opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "/opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "/opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:38 user sudo[80689]: pam_unix(sudo:session): session closed for user root
Apr 13 18:56:38 user nova-compute[71692]: INFO oslo.privsep.daemon [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Spawned new privsep daemon via rootwrap
Apr 13 18:56:38 user nova-compute[71692]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 18:56:38 user nova-compute[71692]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 18:56:38 user nova-compute[71692]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 13 18:56:38 user nova-compute[71692]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80696
Apr 13 18:56:38 user nova-compute[71692]: WARNING oslo_privsep.priv_context [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] privsep daemon already running
Apr 13 18:56:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.166s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.177s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.157s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk 1073741824" returned: 0 in 0.038s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.185s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.150s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.162s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk 1073741824" returned: 0 in 0.054s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Cannot resize image /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG nova.objects.instance [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'migration_context' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Ensure instance console log exists: /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.125s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG nova.network.neutron [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Successfully created port: 1572a520-f7d8-4a48-995e-9a83a99a41c8 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Cannot resize image /opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG nova.objects.instance [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lazy-loading 'migration_context' on Instance uuid b7d32500-da20-4a99-af04-5f422ac6ba0a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Ensure instance console log exists: /opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:39 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Successfully created port: a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:56:42 user nova-compute[71692]: DEBUG nova.network.neutron [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Successfully updated port: 1572a520-f7d8-4a48-995e-9a83a99a41c8 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:56:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "refresh_cache-b7d32500-da20-4a99-af04-5f422ac6ba0a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:56:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquired lock "refresh_cache-b7d32500-da20-4a99-af04-5f422ac6ba0a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:56:42 user nova-compute[71692]: DEBUG nova.network.neutron [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.network.neutron [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "f17525a6-e377-4b33-85cd-88a7aaf4569a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "f17525a6-e377-4b33-85cd-88a7aaf4569a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:56:43 user nova-compute[71692]: INFO nova.compute.claims [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Claim successful on node user
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-cd780622-6685-45a3-bdee-31bfbbd00545 req-00494fcf-8d98-452b-8081-5237174b0e27 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Received event network-changed-1572a520-f7d8-4a48-995e-9a83a99a41c8 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-cd780622-6685-45a3-bdee-31bfbbd00545 req-00494fcf-8d98-452b-8081-5237174b0e27 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Refreshing instance network info cache due to event network-changed-1572a520-f7d8-4a48-995e-9a83a99a41c8. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cd780622-6685-45a3-bdee-31bfbbd00545 req-00494fcf-8d98-452b-8081-5237174b0e27 service nova] Acquiring lock "refresh_cache-b7d32500-da20-4a99-af04-5f422ac6ba0a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Successfully updated port: a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquired lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.network.neutron [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:56:43 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.network.neutron [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Updating instance_info_cache with network_info: [{"id": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "address": "fa:16:3e:33:03:fd", "network": {"id": "4f040dc3-577a-48e7-b46d-413f3b11a1fe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1853453695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577e81535534db29f5c81837949e958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1572a520-f7", "ovs_interfaceid": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Releasing lock "refresh_cache-b7d32500-da20-4a99-af04-5f422ac6ba0a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Instance network_info: |[{"id": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "address": "fa:16:3e:33:03:fd", "network": {"id": "4f040dc3-577a-48e7-b46d-413f3b11a1fe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1853453695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577e81535534db29f5c81837949e958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1572a520-f7", "ovs_interfaceid": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cd780622-6685-45a3-bdee-31bfbbd00545 req-00494fcf-8d98-452b-8081-5237174b0e27 service nova] Acquired lock "refresh_cache-b7d32500-da20-4a99-af04-5f422ac6ba0a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.network.neutron [req-cd780622-6685-45a3-bdee-31bfbbd00545 req-00494fcf-8d98-452b-8081-5237174b0e27 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Refreshing network info cache for port 1572a520-f7d8-4a48-995e-9a83a99a41c8 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Start _get_guest_xml network_info=[{"id": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "address": "fa:16:3e:33:03:fd", "network": {"id": "4f040dc3-577a-48e7-b46d-413f3b11a1fe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1853453695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577e81535534db29f5c81837949e958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1572a520-f7", "ovs_interfaceid": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:56:43 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:56:43 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.privsep.utils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-223135583',display_name='tempest-DeleteServersTestJSON-server-223135583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-223135583',id=1,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b577e81535534db29f5c81837949e958',ramdisk_id='',reservation_id='r-sdrj0lcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-719282196',owner_user_name='tempest-DeleteServersTestJSON-719282196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:56:35Z,user_data=None,user_id='c1424be1648d4e8081f6a679b1407d3a',uuid=b7d32500-da20-4a99-af04-5f422ac6ba0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "address": "fa:16:3e:33:03:fd", "network": {"id": "4f040dc3-577a-48e7-b46d-413f3b11a1fe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1853453695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577e81535534db29f5c81837949e958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1572a520-f7", "ovs_interfaceid": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Converting VIF {"id": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "address": "fa:16:3e:33:03:fd", "network": {"id": "4f040dc3-577a-48e7-b46d-413f3b11a1fe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1853453695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577e81535534db29f5c81837949e958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1572a520-f7", "ovs_interfaceid": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:03:fd,bridge_name='br-int',has_traffic_filtering=True,id=1572a520-f7d8-4a48-995e-9a83a99a41c8,network=Network(4f040dc3-577a-48e7-b46d-413f3b11a1fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1572a520-f7') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.objects.instance [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lazy-loading 'pci_devices' on Instance uuid b7d32500-da20-4a99-af04-5f422ac6ba0a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:56:43 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Creating image(s)
Apr 13 18:56:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "/opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "/opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "/opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-ef1c2b3f-9fc6-4664-9e4b-b33ff9afa5c9 req-73ce1ff7-7ba4-42ac-875b-e135b54858cd service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received event network-changed-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-ef1c2b3f-9fc6-4664-9e4b-b33ff9afa5c9 req-73ce1ff7-7ba4-42ac-875b-e135b54858cd service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Refreshing instance network info cache due to event network-changed-a9907d23-585e-46b6-935d-d2d1f7d840f2. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ef1c2b3f-9fc6-4664-9e4b-b33ff9afa5c9 req-73ce1ff7-7ba4-42ac-875b-e135b54858cd service nova] Acquiring lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:56:43 user nova-compute[71692]:   <uuid>b7d32500-da20-4a99-af04-5f422ac6ba0a</uuid>
Apr 13 18:56:43 user nova-compute[71692]:   <name>instance-00000001</name>
Apr 13 18:56:43 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 18:56:43 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 18:56:43 user nova-compute[71692]:   <metadata>
Apr 13 18:56:43 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:56:43 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 18:56:43 user nova-compute[71692]:       <nova:name>tempest-DeleteServersTestJSON-server-223135583</nova:name>
Apr 13 18:56:43 user nova-compute[71692]:       <nova:creationTime>2023-04-13 18:56:43</nova:creationTime>
Apr 13 18:56:43 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 18:56:43 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 18:56:43 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 18:56:43 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 18:56:43 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:56:43 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:56:43 user nova-compute[71692]:       </nova:flavor>
Apr 13 18:56:43 user nova-compute[71692]:       <nova:owner>
Apr 13 18:56:43 user nova-compute[71692]:         <nova:user uuid="c1424be1648d4e8081f6a679b1407d3a">tempest-DeleteServersTestJSON-719282196-project-member</nova:user>
Apr 13 18:56:43 user nova-compute[71692]:         <nova:project uuid="b577e81535534db29f5c81837949e958">tempest-DeleteServersTestJSON-719282196</nova:project>
Apr 13 18:56:43 user nova-compute[71692]:       </nova:owner>
Apr 13 18:56:43 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 18:56:43 user nova-compute[71692]:       <nova:ports>
Apr 13 18:56:43 user nova-compute[71692]:         <nova:port uuid="1572a520-f7d8-4a48-995e-9a83a99a41c8">
Apr 13 18:56:43 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 18:56:43 user nova-compute[71692]:         </nova:port>
Apr 13 18:56:43 user nova-compute[71692]:       </nova:ports>
Apr 13 18:56:43 user nova-compute[71692]:     </nova:instance>
Apr 13 18:56:43 user nova-compute[71692]:   </metadata>
Apr 13 18:56:43 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 18:56:43 user nova-compute[71692]:     <system>
Apr 13 18:56:43 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:56:43 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:56:43 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 18:56:43 user nova-compute[71692]:       <entry name="serial">b7d32500-da20-4a99-af04-5f422ac6ba0a</entry>
Apr 13 18:56:43 user nova-compute[71692]:       <entry name="uuid">b7d32500-da20-4a99-af04-5f422ac6ba0a</entry>
Apr 13 18:56:43 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:56:43 user nova-compute[71692]:     </system>
Apr 13 18:56:43 user nova-compute[71692]:   </sysinfo>
Apr 13 18:56:43 user nova-compute[71692]:   <os>
Apr 13 18:56:43 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:56:43 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 18:56:43 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 18:56:43 user nova-compute[71692]:   </os>
Apr 13 18:56:43 user nova-compute[71692]:   <features>
Apr 13 18:56:43 user nova-compute[71692]:     <acpi/>
Apr 13 18:56:43 user nova-compute[71692]:     <apic/>
Apr 13 18:56:43 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 18:56:43 user nova-compute[71692]:   </features>
Apr 13 18:56:43 user nova-compute[71692]:   <clock offset="utc">
Apr 13 18:56:43 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:56:43 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:56:43 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 18:56:43 user nova-compute[71692]:   </clock>
Apr 13 18:56:43 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 18:56:43 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 18:56:43 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:56:43 user nova-compute[71692]:   </cpu>
Apr 13 18:56:43 user nova-compute[71692]:   <devices>
Apr 13 18:56:43 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 18:56:43 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:56:43 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk"/>
Apr 13 18:56:43 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 18:56:43 user nova-compute[71692]:     </disk>
Apr 13 18:56:43 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 18:56:43 user nova-compute[71692]:       <mac address="fa:16:3e:33:03:fd"/>
Apr 13 18:56:43 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:56:43 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 18:56:43 user nova-compute[71692]:       <target dev="tap1572a520-f7"/>
Apr 13 18:56:43 user nova-compute[71692]:     </interface>
Apr 13 18:56:43 user nova-compute[71692]:     <serial type="pty">
Apr 13 18:56:43 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/console.log" append="off"/>
Apr 13 18:56:43 user nova-compute[71692]:     </serial>
Apr 13 18:56:43 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:56:43 user nova-compute[71692]:     <video>
Apr 13 18:56:43 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:56:43 user nova-compute[71692]:     </video>
Apr 13 18:56:43 user nova-compute[71692]:     <rng model="virtio">
Apr 13 18:56:43 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:56:43 user nova-compute[71692]:     </rng>
Apr 13 18:56:43 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:56:43 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 18:56:43 user nova-compute[71692]:       <stats period="10"/>
Apr 13 18:56:43 user nova-compute[71692]:     </memballoon>
Apr 13 18:56:43 user nova-compute[71692]:   </devices>
Apr 13 18:56:43 user nova-compute[71692]: </domain>
Apr 13 18:56:43 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-223135583',display_name='tempest-DeleteServersTestJSON-server-223135583',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-223135583',id=1,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b577e81535534db29f5c81837949e958',ramdisk_id='',reservation_id='r-sdrj0lcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-719282196',owner_user_name='tempest-DeleteServersTestJSON-719282196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:56:35Z,user_data=None,user_id='c1424be1648d4e8081f6a679b1407d3a',uuid=b7d32500-da20-4a99-af04-5f422ac6ba0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "address": "fa:16:3e:33:03:fd", "network": {"id": "4f040dc3-577a-48e7-b46d-413f3b11a1fe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1853453695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577e81535534db29f5c81837949e958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1572a520-f7", "ovs_interfaceid": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Converting VIF {"id": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "address": "fa:16:3e:33:03:fd", "network": {"id": "4f040dc3-577a-48e7-b46d-413f3b11a1fe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1853453695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577e81535534db29f5c81837949e958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1572a520-f7", "ovs_interfaceid": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:03:fd,bridge_name='br-int',has_traffic_filtering=True,id=1572a520-f7d8-4a48-995e-9a83a99a41c8,network=Network(4f040dc3-577a-48e7-b46d-413f3b11a1fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1572a520-f7') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:56:43 user nova-compute[71692]: DEBUG os_vif [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:03:fd,bridge_name='br-int',has_traffic_filtering=True,id=1572a520-f7d8-4a48-995e-9a83a99a41c8,network=Network(4f040dc3-577a-48e7-b46d-413f3b11a1fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1572a520-f7') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Created schema index Interface.name {{(pid=71692) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Created schema index Port.name {{(pid=71692) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Created schema index Bridge.name {{(pid=71692) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [POLLOUT] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.182s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG nova.policy [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e7f76b4b7fb4651b3bce0e72f8a4de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1308cc4c5734de9a9fd83688c8da796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:56:44 user nova-compute[71692]: INFO oslo.privsep.daemon [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpo1alfse8/privsep.sock']
Apr 13 18:56:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.116s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:44 user sudo[80743]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpo1alfse8/privsep.sock
Apr 13 18:56:44 user sudo[80743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 18:56:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk 1073741824" returned: 0 in 0.047s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.167s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.129s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Cannot resize image /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG nova.objects.instance [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lazy-loading 'migration_context' on Instance uuid f17525a6-e377-4b33-85cd-88a7aaf4569a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Ensure instance console log exists: /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:45 user nova-compute[71692]: DEBUG nova.network.neutron [req-cd780622-6685-45a3-bdee-31bfbbd00545 req-00494fcf-8d98-452b-8081-5237174b0e27 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Updated VIF entry in instance network info cache for port 1572a520-f7d8-4a48-995e-9a83a99a41c8. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:56:45 user nova-compute[71692]: DEBUG nova.network.neutron [req-cd780622-6685-45a3-bdee-31bfbbd00545 req-00494fcf-8d98-452b-8081-5237174b0e27 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Updating instance_info_cache with network_info: [{"id": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "address": "fa:16:3e:33:03:fd", "network": {"id": "4f040dc3-577a-48e7-b46d-413f3b11a1fe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1853453695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577e81535534db29f5c81837949e958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1572a520-f7", "ovs_interfaceid": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:56:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cd780622-6685-45a3-bdee-31bfbbd00545 req-00494fcf-8d98-452b-8081-5237174b0e27 service nova] Releasing lock "refresh_cache-b7d32500-da20-4a99-af04-5f422ac6ba0a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:56:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:45 user sudo[80743]: pam_unix(sudo:session): session closed for user root
Apr 13 18:56:45 user nova-compute[71692]: INFO oslo.privsep.daemon [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Spawned new privsep daemon via rootwrap
Apr 13 18:56:45 user nova-compute[71692]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 18:56:45 user nova-compute[71692]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 18:56:45 user nova-compute[71692]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 13 18:56:45 user nova-compute[71692]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80758
Apr 13 18:56:45 user nova-compute[71692]: DEBUG nova.network.neutron [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Successfully created port: 209c6974-cf54-4917-a9dc-2608f9eb10d9 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Updating instance_info_cache with network_info: [{"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Releasing lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Instance network_info: |[{"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ef1c2b3f-9fc6-4664-9e4b-b33ff9afa5c9 req-73ce1ff7-7ba4-42ac-875b-e135b54858cd service nova] Acquired lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.network.neutron [req-ef1c2b3f-9fc6-4664-9e4b-b33ff9afa5c9 req-73ce1ff7-7ba4-42ac-875b-e135b54858cd service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Refreshing network info cache for port a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Start _get_guest_xml network_info=[{"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:56:46 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:56:46 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-401678638',display_name='tempest-AttachVolumeTestJSON-server-401678638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-401678638',id=2,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE5B1S6SqZNLSYUvXCtLzlE03oQZAx0ezu9QmfHUm/VQFyAV9bhAsOFjrmYjBIjMOSTPvvajdVY1JHSqXEdUecpJFgE/NvFW0y7bhYdRssG3xIWyUJMMg1figOyi2kGeg==',key_name='tempest-keypair-1245494573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63b52d6508154a918a13b31712b32796',ramdisk_id='',reservation_id='r-ecb50eo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-43043273',owner_user_name='tempest-AttachVolumeTestJSON-43043273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba70f34af8664dc89fd9851d00d5b96d',uuid=a15c1b5e-1769-490a-b81f-09333cd4a227,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converting VIF {"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.objects.instance [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'pci_devices' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:56:46 user nova-compute[71692]:   <uuid>a15c1b5e-1769-490a-b81f-09333cd4a227</uuid>
Apr 13 18:56:46 user nova-compute[71692]:   <name>instance-00000002</name>
Apr 13 18:56:46 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 18:56:46 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 18:56:46 user nova-compute[71692]:   <metadata>
Apr 13 18:56:46 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:56:46 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 18:56:46 user nova-compute[71692]:       <nova:name>tempest-AttachVolumeTestJSON-server-401678638</nova:name>
Apr 13 18:56:46 user nova-compute[71692]:       <nova:creationTime>2023-04-13 18:56:46</nova:creationTime>
Apr 13 18:56:46 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 18:56:46 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 18:56:46 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 18:56:46 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 18:56:46 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:56:46 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:56:46 user nova-compute[71692]:       </nova:flavor>
Apr 13 18:56:46 user nova-compute[71692]:       <nova:owner>
Apr 13 18:56:46 user nova-compute[71692]:         <nova:user uuid="ba70f34af8664dc89fd9851d00d5b96d">tempest-AttachVolumeTestJSON-43043273-project-member</nova:user>
Apr 13 18:56:46 user nova-compute[71692]:         <nova:project uuid="63b52d6508154a918a13b31712b32796">tempest-AttachVolumeTestJSON-43043273</nova:project>
Apr 13 18:56:46 user nova-compute[71692]:       </nova:owner>
Apr 13 18:56:46 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 18:56:46 user nova-compute[71692]:       <nova:ports>
Apr 13 18:56:46 user nova-compute[71692]:         <nova:port uuid="a9907d23-585e-46b6-935d-d2d1f7d840f2">
Apr 13 18:56:46 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 18:56:46 user nova-compute[71692]:         </nova:port>
Apr 13 18:56:46 user nova-compute[71692]:       </nova:ports>
Apr 13 18:56:46 user nova-compute[71692]:     </nova:instance>
Apr 13 18:56:46 user nova-compute[71692]:   </metadata>
Apr 13 18:56:46 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 18:56:46 user nova-compute[71692]:     <system>
Apr 13 18:56:46 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:56:46 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:56:46 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 18:56:46 user nova-compute[71692]:       <entry name="serial">a15c1b5e-1769-490a-b81f-09333cd4a227</entry>
Apr 13 18:56:46 user nova-compute[71692]:       <entry name="uuid">a15c1b5e-1769-490a-b81f-09333cd4a227</entry>
Apr 13 18:56:46 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:56:46 user nova-compute[71692]:     </system>
Apr 13 18:56:46 user nova-compute[71692]:   </sysinfo>
Apr 13 18:56:46 user nova-compute[71692]:   <os>
Apr 13 18:56:46 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:56:46 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 18:56:46 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 18:56:46 user nova-compute[71692]:   </os>
Apr 13 18:56:46 user nova-compute[71692]:   <features>
Apr 13 18:56:46 user nova-compute[71692]:     <acpi/>
Apr 13 18:56:46 user nova-compute[71692]:     <apic/>
Apr 13 18:56:46 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 18:56:46 user nova-compute[71692]:   </features>
Apr 13 18:56:46 user nova-compute[71692]:   <clock offset="utc">
Apr 13 18:56:46 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:56:46 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:56:46 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 18:56:46 user nova-compute[71692]:   </clock>
Apr 13 18:56:46 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 18:56:46 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 18:56:46 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:56:46 user nova-compute[71692]:   </cpu>
Apr 13 18:56:46 user nova-compute[71692]:   <devices>
Apr 13 18:56:46 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 18:56:46 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:56:46 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk"/>
Apr 13 18:56:46 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 18:56:46 user nova-compute[71692]:     </disk>
Apr 13 18:56:46 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 18:56:46 user nova-compute[71692]:       <mac address="fa:16:3e:7b:3b:25"/>
Apr 13 18:56:46 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:56:46 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 18:56:46 user nova-compute[71692]:       <target dev="tapa9907d23-58"/>
Apr 13 18:56:46 user nova-compute[71692]:     </interface>
Apr 13 18:56:46 user nova-compute[71692]:     <serial type="pty">
Apr 13 18:56:46 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/console.log" append="off"/>
Apr 13 18:56:46 user nova-compute[71692]:     </serial>
Apr 13 18:56:46 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:56:46 user nova-compute[71692]:     <video>
Apr 13 18:56:46 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:56:46 user nova-compute[71692]:     </video>
Apr 13 18:56:46 user nova-compute[71692]:     <rng model="virtio">
Apr 13 18:56:46 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:56:46 user nova-compute[71692]:     </rng>
Apr 13 18:56:46 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:56:46 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 18:56:46 user nova-compute[71692]:       <stats period="10"/>
Apr 13 18:56:46 user nova-compute[71692]:     </memballoon>
Apr 13 18:56:46 user nova-compute[71692]:   </devices>
Apr 13 18:56:46 user nova-compute[71692]: </domain>
Apr 13 18:56:46 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-401678638',display_name='tempest-AttachVolumeTestJSON-server-401678638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-401678638',id=2,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE5B1S6SqZNLSYUvXCtLzlE03oQZAx0ezu9QmfHUm/VQFyAV9bhAsOFjrmYjBIjMOSTPvvajdVY1JHSqXEdUecpJFgE/NvFW0y7bhYdRssG3xIWyUJMMg1figOyi2kGeg==',key_name='tempest-keypair-1245494573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63b52d6508154a918a13b31712b32796',ramdisk_id='',reservation_id='r-ecb50eo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-43043273',owner_user_name='tempest-AttachVolumeTestJSON-43043273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:56:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba70f34af8664dc89fd9851d00d5b96d',uuid=a15c1b5e-1769-490a-b81f-09333cd4a227,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converting VIF {"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG os_vif [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1572a520-f7, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1572a520-f7, col_values=(('external_ids', {'iface-id': '1572a520-f7d8-4a48-995e-9a83a99a41c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:03:fd', 'vm-uuid': 'b7d32500-da20-4a99-af04-5f422ac6ba0a'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:46 user nova-compute[71692]: INFO os_vif [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:03:fd,bridge_name='br-int',has_traffic_filtering=True,id=1572a520-f7d8-4a48-995e-9a83a99a41c8,network=Network(4f040dc3-577a-48e7-b46d-413f3b11a1fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1572a520-f7')
Apr 13 18:56:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9907d23-58, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9907d23-58, col_values=(('external_ids', {'iface-id': 'a9907d23-585e-46b6-935d-d2d1f7d840f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:3b:25', 'vm-uuid': 'a15c1b5e-1769-490a-b81f-09333cd4a227'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:46 user nova-compute[71692]: INFO os_vif [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58')
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] No VIF found with MAC fa:16:3e:33:03:fd, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] No VIF found with MAC fa:16:3e:7b:3b:25, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.network.neutron [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Successfully updated port: 209c6974-cf54-4917-a9dc-2608f9eb10d9 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "refresh_cache-f17525a6-e377-4b33-85cd-88a7aaf4569a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquired lock "refresh_cache-f17525a6-e377-4b33-85cd-88a7aaf4569a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:56:46 user nova-compute[71692]: DEBUG nova.network.neutron [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.network.neutron [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-270609c3-5a80-4c1f-b613-1e9dc4ebc7ec req-bf04189b-cea6-4342-aa46-387f1effd095 service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Received event network-changed-209c6974-cf54-4917-a9dc-2608f9eb10d9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-270609c3-5a80-4c1f-b613-1e9dc4ebc7ec req-bf04189b-cea6-4342-aa46-387f1effd095 service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Refreshing instance network info cache due to event network-changed-209c6974-cf54-4917-a9dc-2608f9eb10d9. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-270609c3-5a80-4c1f-b613-1e9dc4ebc7ec req-bf04189b-cea6-4342-aa46-387f1effd095 service nova] Acquiring lock "refresh_cache-f17525a6-e377-4b33-85cd-88a7aaf4569a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.network.neutron [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Updating instance_info_cache with network_info: [{"id": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "address": "fa:16:3e:01:cf:b5", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209c6974-cf", "ovs_interfaceid": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Releasing lock "refresh_cache-f17525a6-e377-4b33-85cd-88a7aaf4569a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Instance network_info: |[{"id": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "address": "fa:16:3e:01:cf:b5", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209c6974-cf", "ovs_interfaceid": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-270609c3-5a80-4c1f-b613-1e9dc4ebc7ec req-bf04189b-cea6-4342-aa46-387f1effd095 service nova] Acquired lock "refresh_cache-f17525a6-e377-4b33-85cd-88a7aaf4569a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.network.neutron [req-270609c3-5a80-4c1f-b613-1e9dc4ebc7ec req-bf04189b-cea6-4342-aa46-387f1effd095 service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Refreshing network info cache for port 209c6974-cf54-4917-a9dc-2608f9eb10d9 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Start _get_guest_xml network_info=[{"id": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "address": "fa:16:3e:01:cf:b5", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209c6974-cf", "ovs_interfaceid": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:56:47 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:56:47 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1933750656',display_name='tempest-ServersNegativeTestJSON-server-1933750656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1933750656',id=3,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1308cc4c5734de9a9fd83688c8da796',ramdisk_id='',reservation_id='r-2ggqv3vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1876599222',owner_user_name='tempest-ServersNegativeTestJSON-1876599222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:56:44Z,user_data=None,user_id='3e7f76b4b7fb4651b3bce0e72f8a4de6',uuid=f17525a6-e377-4b33-85cd-88a7aaf4569a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "address": "fa:16:3e:01:cf:b5", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209c6974-cf", "ovs_interfaceid": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Converting VIF {"id": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "address": "fa:16:3e:01:cf:b5", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209c6974-cf", "ovs_interfaceid": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:cf:b5,bridge_name='br-int',has_traffic_filtering=True,id=209c6974-cf54-4917-a9dc-2608f9eb10d9,network=Network(ae895ef0-18d7-4f77-bcc6-bcb3dd22026f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209c6974-cf') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.objects.instance [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lazy-loading 'pci_devices' on Instance uuid f17525a6-e377-4b33-85cd-88a7aaf4569a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:56:47 user nova-compute[71692]:   <uuid>f17525a6-e377-4b33-85cd-88a7aaf4569a</uuid>
Apr 13 18:56:47 user nova-compute[71692]:   <name>instance-00000003</name>
Apr 13 18:56:47 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 18:56:47 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 18:56:47 user nova-compute[71692]:   <metadata>
Apr 13 18:56:47 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:56:47 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 18:56:47 user nova-compute[71692]:       <nova:name>tempest-ServersNegativeTestJSON-server-1933750656</nova:name>
Apr 13 18:56:47 user nova-compute[71692]:       <nova:creationTime>2023-04-13 18:56:47</nova:creationTime>
Apr 13 18:56:47 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 18:56:47 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 18:56:47 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 18:56:47 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 18:56:47 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:56:47 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:56:47 user nova-compute[71692]:       </nova:flavor>
Apr 13 18:56:47 user nova-compute[71692]:       <nova:owner>
Apr 13 18:56:47 user nova-compute[71692]:         <nova:user uuid="3e7f76b4b7fb4651b3bce0e72f8a4de6">tempest-ServersNegativeTestJSON-1876599222-project-member</nova:user>
Apr 13 18:56:47 user nova-compute[71692]:         <nova:project uuid="a1308cc4c5734de9a9fd83688c8da796">tempest-ServersNegativeTestJSON-1876599222</nova:project>
Apr 13 18:56:47 user nova-compute[71692]:       </nova:owner>
Apr 13 18:56:47 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 18:56:47 user nova-compute[71692]:       <nova:ports>
Apr 13 18:56:47 user nova-compute[71692]:         <nova:port uuid="209c6974-cf54-4917-a9dc-2608f9eb10d9">
Apr 13 18:56:47 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 18:56:47 user nova-compute[71692]:         </nova:port>
Apr 13 18:56:47 user nova-compute[71692]:       </nova:ports>
Apr 13 18:56:47 user nova-compute[71692]:     </nova:instance>
Apr 13 18:56:47 user nova-compute[71692]:   </metadata>
Apr 13 18:56:47 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 18:56:47 user nova-compute[71692]:     <system>
Apr 13 18:56:47 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:56:47 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:56:47 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 18:56:47 user nova-compute[71692]:       <entry name="serial">f17525a6-e377-4b33-85cd-88a7aaf4569a</entry>
Apr 13 18:56:47 user nova-compute[71692]:       <entry name="uuid">f17525a6-e377-4b33-85cd-88a7aaf4569a</entry>
Apr 13 18:56:47 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:56:47 user nova-compute[71692]:     </system>
Apr 13 18:56:47 user nova-compute[71692]:   </sysinfo>
Apr 13 18:56:47 user nova-compute[71692]:   <os>
Apr 13 18:56:47 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:56:47 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 18:56:47 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 18:56:47 user nova-compute[71692]:   </os>
Apr 13 18:56:47 user nova-compute[71692]:   <features>
Apr 13 18:56:47 user nova-compute[71692]:     <acpi/>
Apr 13 18:56:47 user nova-compute[71692]:     <apic/>
Apr 13 18:56:47 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 18:56:47 user nova-compute[71692]:   </features>
Apr 13 18:56:47 user nova-compute[71692]:   <clock offset="utc">
Apr 13 18:56:47 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:56:47 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:56:47 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 18:56:47 user nova-compute[71692]:   </clock>
Apr 13 18:56:47 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 18:56:47 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 18:56:47 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:56:47 user nova-compute[71692]:   </cpu>
Apr 13 18:56:47 user nova-compute[71692]:   <devices>
Apr 13 18:56:47 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 18:56:47 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:56:47 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk"/>
Apr 13 18:56:47 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 18:56:47 user nova-compute[71692]:     </disk>
Apr 13 18:56:47 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 18:56:47 user nova-compute[71692]:       <mac address="fa:16:3e:01:cf:b5"/>
Apr 13 18:56:47 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:56:47 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 18:56:47 user nova-compute[71692]:       <target dev="tap209c6974-cf"/>
Apr 13 18:56:47 user nova-compute[71692]:     </interface>
Apr 13 18:56:47 user nova-compute[71692]:     <serial type="pty">
Apr 13 18:56:47 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/console.log" append="off"/>
Apr 13 18:56:47 user nova-compute[71692]:     </serial>
Apr 13 18:56:47 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:56:47 user nova-compute[71692]:     <video>
Apr 13 18:56:47 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:56:47 user nova-compute[71692]:     </video>
Apr 13 18:56:47 user nova-compute[71692]:     <rng model="virtio">
Apr 13 18:56:47 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:56:47 user nova-compute[71692]:     </rng>
Apr 13 18:56:47 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:56:47 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 18:56:47 user nova-compute[71692]:       <stats period="10"/>
Apr 13 18:56:47 user nova-compute[71692]:     </memballoon>
Apr 13 18:56:47 user nova-compute[71692]:   </devices>
Apr 13 18:56:47 user nova-compute[71692]: </domain>
Apr 13 18:56:47 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1933750656',display_name='tempest-ServersNegativeTestJSON-server-1933750656',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1933750656',id=3,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1308cc4c5734de9a9fd83688c8da796',ramdisk_id='',reservation_id='r-2ggqv3vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1876599222',owner_user_name='tempest-ServersNegativeTestJSON-1876599222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:56:44Z,user_data=None,user_id='3e7f76b4b7fb4651b3bce0e72f8a4de6',uuid=f17525a6-e377-4b33-85cd-88a7aaf4569a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "address": "fa:16:3e:01:cf:b5", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209c6974-cf", "ovs_interfaceid": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Converting VIF {"id": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "address": "fa:16:3e:01:cf:b5", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209c6974-cf", "ovs_interfaceid": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:cf:b5,bridge_name='br-int',has_traffic_filtering=True,id=209c6974-cf54-4917-a9dc-2608f9eb10d9,network=Network(ae895ef0-18d7-4f77-bcc6-bcb3dd22026f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209c6974-cf') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG os_vif [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:cf:b5,bridge_name='br-int',has_traffic_filtering=True,id=209c6974-cf54-4917-a9dc-2608f9eb10d9,network=Network(ae895ef0-18d7-4f77-bcc6-bcb3dd22026f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209c6974-cf') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap209c6974-cf, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap209c6974-cf, col_values=(('external_ids', {'iface-id': '209c6974-cf54-4917-a9dc-2608f9eb10d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:cf:b5', 'vm-uuid': 'f17525a6-e377-4b33-85cd-88a7aaf4569a'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:56:47 user nova-compute[71692]: INFO nova.compute.claims [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Claim successful on node user
Apr 13 18:56:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:47 user nova-compute[71692]: INFO os_vif [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:cf:b5,bridge_name='br-int',has_traffic_filtering=True,id=209c6974-cf54-4917-a9dc-2608f9eb10d9,network=Network(ae895ef0-18d7-4f77-bcc6-bcb3dd22026f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209c6974-cf')
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] No VIF found with MAC fa:16:3e:01:cf:b5, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:56:47 user nova-compute[71692]: DEBUG nova.network.neutron [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:56:47 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:56:48 user nova-compute[71692]: DEBUG nova.compute.manager [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG nova.network.neutron [req-270609c3-5a80-4c1f-b613-1e9dc4ebc7ec req-bf04189b-cea6-4342-aa46-387f1effd095 service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Updated VIF entry in instance network info cache for port 209c6974-cf54-4917-a9dc-2608f9eb10d9. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG nova.network.neutron [req-270609c3-5a80-4c1f-b613-1e9dc4ebc7ec req-bf04189b-cea6-4342-aa46-387f1effd095 service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Updating instance_info_cache with network_info: [{"id": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "address": "fa:16:3e:01:cf:b5", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209c6974-cf", "ovs_interfaceid": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-270609c3-5a80-4c1f-b613-1e9dc4ebc7ec req-bf04189b-cea6-4342-aa46-387f1effd095 service nova] Releasing lock "refresh_cache-f17525a6-e377-4b33-85cd-88a7aaf4569a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG nova.compute.manager [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:56:48 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Creating image(s)
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "/opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "/opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG nova.policy [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.152s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk 1073741824" returned: 0 in 0.049s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.145s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Cannot resize image /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG nova.objects.instance [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'migration_context' on Instance uuid ca1b4132-15bd-4d4e-8d0c-d074824c888f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG nova.network.neutron [req-ef1c2b3f-9fc6-4664-9e4b-b33ff9afa5c9 req-73ce1ff7-7ba4-42ac-875b-e135b54858cd service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Updated VIF entry in instance network info cache for port a9907d23-585e-46b6-935d-d2d1f7d840f2. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG nova.network.neutron [req-ef1c2b3f-9fc6-4664-9e4b-b33ff9afa5c9 req-73ce1ff7-7ba4-42ac-875b-e135b54858cd service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Updating instance_info_cache with network_info: [{"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Ensure instance console log exists: /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ef1c2b3f-9fc6-4664-9e4b-b33ff9afa5c9 req-73ce1ff7-7ba4-42ac-875b-e135b54858cd service nova] Releasing lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:56:49 user nova-compute[71692]: INFO nova.compute.claims [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Claim successful on node user
Apr 13 18:56:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG nova.network.neutron [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:56:49 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:56:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:56:49 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Creating image(s)
Apr 13 18:56:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "/opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "/opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "/opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.205s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG nova.policy [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG nova.network.neutron [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Successfully created port: 5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.168s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk 1073741824" returned: 0 in 0.050s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.128s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Cannot resize image /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG nova.objects.instance [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'migration_context' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Ensure instance console log exists: /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG nova.compute.manager [req-696e7709-1f9d-4919-9d40-ef4568020790 req-eb4fd218-e9bc-488d-8d99-f6fe5fcf0ed5 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Received event network-vif-plugged-1572a520-f7d8-4a48-995e-9a83a99a41c8 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-696e7709-1f9d-4919-9d40-ef4568020790 req-eb4fd218-e9bc-488d-8d99-f6fe5fcf0ed5 service nova] Acquiring lock "b7d32500-da20-4a99-af04-5f422ac6ba0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-696e7709-1f9d-4919-9d40-ef4568020790 req-eb4fd218-e9bc-488d-8d99-f6fe5fcf0ed5 service nova] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-696e7709-1f9d-4919-9d40-ef4568020790 req-eb4fd218-e9bc-488d-8d99-f6fe5fcf0ed5 service nova] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:50 user nova-compute[71692]: DEBUG nova.compute.manager [req-696e7709-1f9d-4919-9d40-ef4568020790 req-eb4fd218-e9bc-488d-8d99-f6fe5fcf0ed5 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] No waiting events found dispatching network-vif-plugged-1572a520-f7d8-4a48-995e-9a83a99a41c8 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:56:50 user nova-compute[71692]: WARNING nova.compute.manager [req-696e7709-1f9d-4919-9d40-ef4568020790 req-eb4fd218-e9bc-488d-8d99-f6fe5fcf0ed5 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Received unexpected event network-vif-plugged-1572a520-f7d8-4a48-995e-9a83a99a41c8 for instance with vm_state building and task_state spawning.
Apr 13 18:56:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:51 user nova-compute[71692]: DEBUG nova.compute.manager [req-76bd335b-ad71-4b13-b005-0ea3b8715aa6 req-91dc4cce-a47b-4d54-a24b-bbfcfe596e0d service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:56:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-76bd335b-ad71-4b13-b005-0ea3b8715aa6 req-91dc4cce-a47b-4d54-a24b-bbfcfe596e0d service nova] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-76bd335b-ad71-4b13-b005-0ea3b8715aa6 req-91dc4cce-a47b-4d54-a24b-bbfcfe596e0d service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-76bd335b-ad71-4b13-b005-0ea3b8715aa6 req-91dc4cce-a47b-4d54-a24b-bbfcfe596e0d service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:51 user nova-compute[71692]: DEBUG nova.compute.manager [req-76bd335b-ad71-4b13-b005-0ea3b8715aa6 req-91dc4cce-a47b-4d54-a24b-bbfcfe596e0d service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] No waiting events found dispatching network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:56:51 user nova-compute[71692]: WARNING nova.compute.manager [req-76bd335b-ad71-4b13-b005-0ea3b8715aa6 req-91dc4cce-a47b-4d54-a24b-bbfcfe596e0d service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received unexpected event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance with vm_state building and task_state spawning.
Apr 13 18:56:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.network.neutron [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Successfully created port: 2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412212.72064, a15c1b5e-1769-490a-b81f-09333cd4a227 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:56:52 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] VM Resumed (Lifecycle Event)
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:56:52 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Instance spawned successfully.
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:56:52 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Instance spawned successfully.
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:56:52 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Instance spawned successfully.
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:56:52 user nova-compute[71692]: INFO nova.compute.manager [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Took 9.09 seconds to spawn the instance on the hypervisor.
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:56:52 user nova-compute[71692]: INFO nova.compute.manager [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Took 15.18 seconds to spawn the instance on the hypervisor.
Apr 13 18:56:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:56:53 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412212.7272308, f17525a6-e377-4b33-85cd-88a7aaf4569a => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:56:53 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] VM Resumed (Lifecycle Event)
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-6151c928-9988-4cd4-97ae-8c9e7268f7d7 req-d3c21d5d-166e-4024-9dd8-1e4016c08cc2 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Received event network-vif-plugged-1572a520-f7d8-4a48-995e-9a83a99a41c8 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6151c928-9988-4cd4-97ae-8c9e7268f7d7 req-d3c21d5d-166e-4024-9dd8-1e4016c08cc2 service nova] Acquiring lock "b7d32500-da20-4a99-af04-5f422ac6ba0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6151c928-9988-4cd4-97ae-8c9e7268f7d7 req-d3c21d5d-166e-4024-9dd8-1e4016c08cc2 service nova] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6151c928-9988-4cd4-97ae-8c9e7268f7d7 req-d3c21d5d-166e-4024-9dd8-1e4016c08cc2 service nova] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-6151c928-9988-4cd4-97ae-8c9e7268f7d7 req-d3c21d5d-166e-4024-9dd8-1e4016c08cc2 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] No waiting events found dispatching network-vif-plugged-1572a520-f7d8-4a48-995e-9a83a99a41c8 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:56:53 user nova-compute[71692]: WARNING nova.compute.manager [req-6151c928-9988-4cd4-97ae-8c9e7268f7d7 req-d3c21d5d-166e-4024-9dd8-1e4016c08cc2 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Received unexpected event network-vif-plugged-1572a520-f7d8-4a48-995e-9a83a99a41c8 for instance with vm_state building and task_state spawning.
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:56:53 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412212.7290504, a15c1b5e-1769-490a-b81f-09333cd4a227 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:56:53 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] VM Started (Lifecycle Event)
Apr 13 18:56:53 user nova-compute[71692]: INFO nova.compute.manager [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Took 9.95 seconds to build instance.
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:56:53 user nova-compute[71692]: INFO nova.compute.manager [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Took 16.15 seconds to build instance.
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412212.729731, f17525a6-e377-4b33-85cd-88a7aaf4569a => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:56:53 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] VM Started (Lifecycle Event)
Apr 13 18:56:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59696821-fc5c-48f9-9c1f-689ec4ff2f3a tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "f17525a6-e377-4b33-85cd-88a7aaf4569a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.122s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-6b27f713-98bd-468c-b045-2e990cbe0684 req-78a3a887-6e40-4590-a4bf-55d13ef69906 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6b27f713-98bd-468c-b045-2e990cbe0684 req-78a3a887-6e40-4590-a4bf-55d13ef69906 service nova] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6b27f713-98bd-468c-b045-2e990cbe0684 req-78a3a887-6e40-4590-a4bf-55d13ef69906 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6b27f713-98bd-468c-b045-2e990cbe0684 req-78a3a887-6e40-4590-a4bf-55d13ef69906 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-6b27f713-98bd-468c-b045-2e990cbe0684 req-78a3a887-6e40-4590-a4bf-55d13ef69906 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] No waiting events found dispatching network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:56:53 user nova-compute[71692]: WARNING nova.compute.manager [req-6b27f713-98bd-468c-b045-2e990cbe0684 req-78a3a887-6e40-4590-a4bf-55d13ef69906 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received unexpected event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance with vm_state active and task_state None.
Apr 13 18:56:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4df63fd-250e-4ea2-8a98-27184b994e06 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.364s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:53 user nova-compute[71692]: INFO nova.compute.manager [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Took 17.89 seconds to spawn the instance on the hypervisor.
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412212.8604076, b7d32500-da20-4a99-af04-5f422ac6ba0a => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:56:53 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] VM Resumed (Lifecycle Event)
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:56:53 user nova-compute[71692]: INFO nova.compute.manager [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Took 18.87 seconds to build instance.
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412212.8621442, b7d32500-da20-4a99-af04-5f422ac6ba0a => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:56:53 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] VM Started (Lifecycle Event)
Apr 13 18:56:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-70b1b237-acfa-43b2-a284-856bf799fa4f tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.077s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:56:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:56:54 user nova-compute[71692]: DEBUG nova.network.neutron [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Successfully updated port: 5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:56:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:56:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquired lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:56:54 user nova-compute[71692]: DEBUG nova.network.neutron [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:56:54 user nova-compute[71692]: DEBUG nova.network.neutron [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:56:54 user nova-compute[71692]: DEBUG nova.network.neutron [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Successfully updated port: 2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:56:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:56:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquired lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:56:54 user nova-compute[71692]: DEBUG nova.network.neutron [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.compute.manager [req-1bfce662-bb8c-4806-b20b-534666dad457 req-23c03f91-cf57-4bee-9dcd-9e9f4bf9a378 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-changed-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.compute.manager [req-1bfce662-bb8c-4806-b20b-534666dad457 req-23c03f91-cf57-4bee-9dcd-9e9f4bf9a378 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Refreshing instance network info cache due to event network-changed-2b297ca1-e672-438a-917a-df2319262bc0. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1bfce662-bb8c-4806-b20b-534666dad457 req-23c03f91-cf57-4bee-9dcd-9e9f4bf9a378 service nova] Acquiring lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.network.neutron [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.compute.manager [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Received event network-vif-plugged-209c6974-cf54-4917-a9dc-2608f9eb10d9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] Acquiring lock "f17525a6-e377-4b33-85cd-88a7aaf4569a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] Lock "f17525a6-e377-4b33-85cd-88a7aaf4569a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] Lock "f17525a6-e377-4b33-85cd-88a7aaf4569a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.compute.manager [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] No waiting events found dispatching network-vif-plugged-209c6974-cf54-4917-a9dc-2608f9eb10d9 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:56:55 user nova-compute[71692]: WARNING nova.compute.manager [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Received unexpected event network-vif-plugged-209c6974-cf54-4917-a9dc-2608f9eb10d9 for instance with vm_state active and task_state None.
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.compute.manager [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received event network-changed-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.compute.manager [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Refreshing instance network info cache due to event network-changed-5a439b7e-d075-4d9e-9673-523b5aa356fd. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] Acquiring lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.network.neutron [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating instance_info_cache with network_info: [{"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Releasing lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.compute.manager [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Instance network_info: |[{"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1bfce662-bb8c-4806-b20b-534666dad457 req-23c03f91-cf57-4bee-9dcd-9e9f4bf9a378 service nova] Acquired lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.network.neutron [req-1bfce662-bb8c-4806-b20b-534666dad457 req-23c03f91-cf57-4bee-9dcd-9e9f4bf9a378 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Refreshing network info cache for port 2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Start _get_guest_xml network_info=[{"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:56:55 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:56:55 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:56:55 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-657008190',display_name='tempest-ServerActionsTestJSON-server-657008190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-657008190',id=5,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-zw23yzik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.objects.instance [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'pci_devices' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:56:56 user nova-compute[71692]:   <uuid>b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8</uuid>
Apr 13 18:56:56 user nova-compute[71692]:   <name>instance-00000005</name>
Apr 13 18:56:56 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 18:56:56 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 18:56:56 user nova-compute[71692]:   <metadata>
Apr 13 18:56:56 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:56:56 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 18:56:56 user nova-compute[71692]:       <nova:name>tempest-ServerActionsTestJSON-server-657008190</nova:name>
Apr 13 18:56:56 user nova-compute[71692]:       <nova:creationTime>2023-04-13 18:56:55</nova:creationTime>
Apr 13 18:56:56 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 18:56:56 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 18:56:56 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 18:56:56 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 18:56:56 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:56:56 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:56:56 user nova-compute[71692]:       </nova:flavor>
Apr 13 18:56:56 user nova-compute[71692]:       <nova:owner>
Apr 13 18:56:56 user nova-compute[71692]:         <nova:user uuid="df209814208d415e9d414d39205aaad6">tempest-ServerActionsTestJSON-1901931474-project-member</nova:user>
Apr 13 18:56:56 user nova-compute[71692]:         <nova:project uuid="c162f91cba4b4ecf9de48fbf839da261">tempest-ServerActionsTestJSON-1901931474</nova:project>
Apr 13 18:56:56 user nova-compute[71692]:       </nova:owner>
Apr 13 18:56:56 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 18:56:56 user nova-compute[71692]:       <nova:ports>
Apr 13 18:56:56 user nova-compute[71692]:         <nova:port uuid="2b297ca1-e672-438a-917a-df2319262bc0">
Apr 13 18:56:56 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 18:56:56 user nova-compute[71692]:         </nova:port>
Apr 13 18:56:56 user nova-compute[71692]:       </nova:ports>
Apr 13 18:56:56 user nova-compute[71692]:     </nova:instance>
Apr 13 18:56:56 user nova-compute[71692]:   </metadata>
Apr 13 18:56:56 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 18:56:56 user nova-compute[71692]:     <system>
Apr 13 18:56:56 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:56:56 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:56:56 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 18:56:56 user nova-compute[71692]:       <entry name="serial">b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8</entry>
Apr 13 18:56:56 user nova-compute[71692]:       <entry name="uuid">b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8</entry>
Apr 13 18:56:56 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:56:56 user nova-compute[71692]:     </system>
Apr 13 18:56:56 user nova-compute[71692]:   </sysinfo>
Apr 13 18:56:56 user nova-compute[71692]:   <os>
Apr 13 18:56:56 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:56:56 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 18:56:56 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 18:56:56 user nova-compute[71692]:   </os>
Apr 13 18:56:56 user nova-compute[71692]:   <features>
Apr 13 18:56:56 user nova-compute[71692]:     <acpi/>
Apr 13 18:56:56 user nova-compute[71692]:     <apic/>
Apr 13 18:56:56 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 18:56:56 user nova-compute[71692]:   </features>
Apr 13 18:56:56 user nova-compute[71692]:   <clock offset="utc">
Apr 13 18:56:56 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:56:56 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:56:56 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 18:56:56 user nova-compute[71692]:   </clock>
Apr 13 18:56:56 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 18:56:56 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 18:56:56 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:56:56 user nova-compute[71692]:   </cpu>
Apr 13 18:56:56 user nova-compute[71692]:   <devices>
Apr 13 18:56:56 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 18:56:56 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:56:56 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk"/>
Apr 13 18:56:56 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 18:56:56 user nova-compute[71692]:     </disk>
Apr 13 18:56:56 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 18:56:56 user nova-compute[71692]:       <mac address="fa:16:3e:bc:71:09"/>
Apr 13 18:56:56 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:56:56 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 18:56:56 user nova-compute[71692]:       <target dev="tap2b297ca1-e6"/>
Apr 13 18:56:56 user nova-compute[71692]:     </interface>
Apr 13 18:56:56 user nova-compute[71692]:     <serial type="pty">
Apr 13 18:56:56 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/console.log" append="off"/>
Apr 13 18:56:56 user nova-compute[71692]:     </serial>
Apr 13 18:56:56 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:56:56 user nova-compute[71692]:     <video>
Apr 13 18:56:56 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:56:56 user nova-compute[71692]:     </video>
Apr 13 18:56:56 user nova-compute[71692]:     <rng model="virtio">
Apr 13 18:56:56 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:56:56 user nova-compute[71692]:     </rng>
Apr 13 18:56:56 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:56:56 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 18:56:56 user nova-compute[71692]:       <stats period="10"/>
Apr 13 18:56:56 user nova-compute[71692]:     </memballoon>
Apr 13 18:56:56 user nova-compute[71692]:   </devices>
Apr 13 18:56:56 user nova-compute[71692]: </domain>
Apr 13 18:56:56 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-657008190',display_name='tempest-ServerActionsTestJSON-server-657008190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-657008190',id=5,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-zw23yzik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:56:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG os_vif [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b297ca1-e6, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b297ca1-e6, col_values=(('external_ids', {'iface-id': '2b297ca1-e672-438a-917a-df2319262bc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:71:09', 'vm-uuid': 'b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:56 user nova-compute[71692]: INFO os_vif [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6')
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.network.neutron [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Updating instance_info_cache with network_info: [{"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No VIF found with MAC fa:16:3e:bc:71:09, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Releasing lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Instance network_info: |[{"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] Acquired lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.network.neutron [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Refreshing network info cache for port 5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Start _get_guest_xml network_info=[{"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:56:56 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:56:56 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-167054456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-167054456',id=4,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMydqo7bmRL3ACZzwkGDc5E4wLELR7X8fXhb12zGOXMBXei6xirNWcHiWE3B5l9MrFe74EHnr4RXCIBAisEn3x6JzBkNkUkW7rpPbUx5zSUBeEYIWhZNJiv3ehZ9wfugA==',key_name='tempest-keypair-1219895845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faabdcc8e61c452ab3b934b1c9501e68',ramdisk_id='',reservation_id='r-mi7i79i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1546308967',owner_user_name='tempest-AttachVolumeShelveTestJSON-1546308967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:56:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee6c76c605d54b4f84e0596b27087f0b',uuid=ca1b4132-15bd-4d4e-8d0c-d074824c888f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converting VIF {"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=5a439b7e-d075-4d9e-9673-523b5aa356fd,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a439b7e-d0') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.objects.instance [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'pci_devices' on Instance uuid ca1b4132-15bd-4d4e-8d0c-d074824c888f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:56:56 user nova-compute[71692]:   <uuid>ca1b4132-15bd-4d4e-8d0c-d074824c888f</uuid>
Apr 13 18:56:56 user nova-compute[71692]:   <name>instance-00000004</name>
Apr 13 18:56:56 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 18:56:56 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 18:56:56 user nova-compute[71692]:   <metadata>
Apr 13 18:56:56 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:56:56 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 18:56:56 user nova-compute[71692]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-167054456</nova:name>
Apr 13 18:56:56 user nova-compute[71692]:       <nova:creationTime>2023-04-13 18:56:56</nova:creationTime>
Apr 13 18:56:56 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 18:56:56 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 18:56:56 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 18:56:56 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 18:56:56 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:56:56 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:56:56 user nova-compute[71692]:       </nova:flavor>
Apr 13 18:56:56 user nova-compute[71692]:       <nova:owner>
Apr 13 18:56:56 user nova-compute[71692]:         <nova:user uuid="ee6c76c605d54b4f84e0596b27087f0b">tempest-AttachVolumeShelveTestJSON-1546308967-project-member</nova:user>
Apr 13 18:56:56 user nova-compute[71692]:         <nova:project uuid="faabdcc8e61c452ab3b934b1c9501e68">tempest-AttachVolumeShelveTestJSON-1546308967</nova:project>
Apr 13 18:56:56 user nova-compute[71692]:       </nova:owner>
Apr 13 18:56:56 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 18:56:56 user nova-compute[71692]:       <nova:ports>
Apr 13 18:56:56 user nova-compute[71692]:         <nova:port uuid="5a439b7e-d075-4d9e-9673-523b5aa356fd">
Apr 13 18:56:56 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 18:56:56 user nova-compute[71692]:         </nova:port>
Apr 13 18:56:56 user nova-compute[71692]:       </nova:ports>
Apr 13 18:56:56 user nova-compute[71692]:     </nova:instance>
Apr 13 18:56:56 user nova-compute[71692]:   </metadata>
Apr 13 18:56:56 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 18:56:56 user nova-compute[71692]:     <system>
Apr 13 18:56:56 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:56:56 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:56:56 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 18:56:56 user nova-compute[71692]:       <entry name="serial">ca1b4132-15bd-4d4e-8d0c-d074824c888f</entry>
Apr 13 18:56:56 user nova-compute[71692]:       <entry name="uuid">ca1b4132-15bd-4d4e-8d0c-d074824c888f</entry>
Apr 13 18:56:56 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:56:56 user nova-compute[71692]:     </system>
Apr 13 18:56:56 user nova-compute[71692]:   </sysinfo>
Apr 13 18:56:56 user nova-compute[71692]:   <os>
Apr 13 18:56:56 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:56:56 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 18:56:56 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 18:56:56 user nova-compute[71692]:   </os>
Apr 13 18:56:56 user nova-compute[71692]:   <features>
Apr 13 18:56:56 user nova-compute[71692]:     <acpi/>
Apr 13 18:56:56 user nova-compute[71692]:     <apic/>
Apr 13 18:56:56 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 18:56:56 user nova-compute[71692]:   </features>
Apr 13 18:56:56 user nova-compute[71692]:   <clock offset="utc">
Apr 13 18:56:56 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:56:56 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:56:56 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 18:56:56 user nova-compute[71692]:   </clock>
Apr 13 18:56:56 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 18:56:56 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 18:56:56 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:56:56 user nova-compute[71692]:   </cpu>
Apr 13 18:56:56 user nova-compute[71692]:   <devices>
Apr 13 18:56:56 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 18:56:56 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:56:56 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk"/>
Apr 13 18:56:56 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 18:56:56 user nova-compute[71692]:     </disk>
Apr 13 18:56:56 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 18:56:56 user nova-compute[71692]:       <mac address="fa:16:3e:55:cb:ae"/>
Apr 13 18:56:56 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:56:56 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 18:56:56 user nova-compute[71692]:       <target dev="tap5a439b7e-d0"/>
Apr 13 18:56:56 user nova-compute[71692]:     </interface>
Apr 13 18:56:56 user nova-compute[71692]:     <serial type="pty">
Apr 13 18:56:56 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/console.log" append="off"/>
Apr 13 18:56:56 user nova-compute[71692]:     </serial>
Apr 13 18:56:56 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:56:56 user nova-compute[71692]:     <video>
Apr 13 18:56:56 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:56:56 user nova-compute[71692]:     </video>
Apr 13 18:56:56 user nova-compute[71692]:     <rng model="virtio">
Apr 13 18:56:56 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:56:56 user nova-compute[71692]:     </rng>
Apr 13 18:56:56 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:56:56 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 18:56:56 user nova-compute[71692]:       <stats period="10"/>
Apr 13 18:56:56 user nova-compute[71692]:     </memballoon>
Apr 13 18:56:56 user nova-compute[71692]:   </devices>
Apr 13 18:56:56 user nova-compute[71692]: </domain>
Apr 13 18:56:56 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-167054456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-167054456',id=4,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMydqo7bmRL3ACZzwkGDc5E4wLELR7X8fXhb12zGOXMBXei6xirNWcHiWE3B5l9MrFe74EHnr4RXCIBAisEn3x6JzBkNkUkW7rpPbUx5zSUBeEYIWhZNJiv3ehZ9wfugA==',key_name='tempest-keypair-1219895845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faabdcc8e61c452ab3b934b1c9501e68',ramdisk_id='',reservation_id='r-mi7i79i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1546308967',owner_user_name='tempest-AttachVolumeShelveTestJSON-1546308967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:56:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee6c76c605d54b4f84e0596b27087f0b',uuid=ca1b4132-15bd-4d4e-8d0c-d074824c888f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converting VIF {"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=5a439b7e-d075-4d9e-9673-523b5aa356fd,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a439b7e-d0') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG os_vif [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=5a439b7e-d075-4d9e-9673-523b5aa356fd,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a439b7e-d0') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a439b7e-d0, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5a439b7e-d0, col_values=(('external_ids', {'iface-id': '5a439b7e-d075-4d9e-9673-523b5aa356fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:cb:ae', 'vm-uuid': 'ca1b4132-15bd-4d4e-8d0c-d074824c888f'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:56 user nova-compute[71692]: INFO os_vif [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=5a439b7e-d075-4d9e-9673-523b5aa356fd,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a439b7e-d0')
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:56:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] No VIF found with MAC fa:16:3e:55:cb:ae, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:56:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:57 user nova-compute[71692]: DEBUG nova.network.neutron [req-1bfce662-bb8c-4806-b20b-534666dad457 req-23c03f91-cf57-4bee-9dcd-9e9f4bf9a378 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updated VIF entry in instance network info cache for port 2b297ca1-e672-438a-917a-df2319262bc0. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:56:57 user nova-compute[71692]: DEBUG nova.network.neutron [req-1bfce662-bb8c-4806-b20b-534666dad457 req-23c03f91-cf57-4bee-9dcd-9e9f4bf9a378 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating instance_info_cache with network_info: [{"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:56:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1bfce662-bb8c-4806-b20b-534666dad457 req-23c03f91-cf57-4bee-9dcd-9e9f4bf9a378 service nova] Releasing lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:56:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-f9360e49-5663-4c8f-ad33-845674736782 req-72c3225b-3f57-46fd-a63c-b036cbc60ef1 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:56:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f9360e49-5663-4c8f-ad33-845674736782 req-72c3225b-3f57-46fd-a63c-b036cbc60ef1 service nova] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:56:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f9360e49-5663-4c8f-ad33-845674736782 req-72c3225b-3f57-46fd-a63c-b036cbc60ef1 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:56:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f9360e49-5663-4c8f-ad33-845674736782 req-72c3225b-3f57-46fd-a63c-b036cbc60ef1 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:56:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-f9360e49-5663-4c8f-ad33-845674736782 req-72c3225b-3f57-46fd-a63c-b036cbc60ef1 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] No waiting events found dispatching network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:56:59 user nova-compute[71692]: WARNING nova.compute.manager [req-f9360e49-5663-4c8f-ad33-845674736782 req-72c3225b-3f57-46fd-a63c-b036cbc60ef1 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received unexpected event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 for instance with vm_state building and task_state spawning.
Apr 13 18:56:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:56:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:00 user nova-compute[71692]: DEBUG nova.network.neutron [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Updated VIF entry in instance network info cache for port 5a439b7e-d075-4d9e-9673-523b5aa356fd. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:57:00 user nova-compute[71692]: DEBUG nova.network.neutron [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Updating instance_info_cache with network_info: [{"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:57:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] Releasing lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:57:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Received event network-vif-plugged-209c6974-cf54-4917-a9dc-2608f9eb10d9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] Acquiring lock "f17525a6-e377-4b33-85cd-88a7aaf4569a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] Lock "f17525a6-e377-4b33-85cd-88a7aaf4569a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] Lock "f17525a6-e377-4b33-85cd-88a7aaf4569a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] No waiting events found dispatching network-vif-plugged-209c6974-cf54-4917-a9dc-2608f9eb10d9 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:57:00 user nova-compute[71692]: WARNING nova.compute.manager [req-9799f28d-fb60-4706-a437-d60d11aa191d req-fcf6e56b-b84d-45eb-b1e7-4a3966378a38 service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Received unexpected event network-vif-plugged-209c6974-cf54-4917-a9dc-2608f9eb10d9 for instance with vm_state active and task_state None.
Apr 13 18:57:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] No waiting events found dispatching network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:57:01 user nova-compute[71692]: WARNING nova.compute.manager [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received unexpected event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 for instance with vm_state building and task_state spawning.
Apr 13 18:57:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received event network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] Acquiring lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] No waiting events found dispatching network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:57:01 user nova-compute[71692]: WARNING nova.compute.manager [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received unexpected event network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd for instance with vm_state building and task_state spawning.
Apr 13 18:57:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received event network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] Acquiring lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] No waiting events found dispatching network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:57:01 user nova-compute[71692]: WARNING nova.compute.manager [req-775a3807-5770-4b2a-b347-c6924f76d459 req-118e6bd6-30d5-4d2e-bd41-23ab4e855cfc service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received unexpected event network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd for instance with vm_state building and task_state spawning.
Apr 13 18:57:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412222.6809232, ca1b4132-15bd-4d4e-8d0c-d074824c888f => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:57:02 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] VM Resumed (Lifecycle Event)
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.compute.manager [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:57:02 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Instance spawned successfully.
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.compute.manager [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:57:02 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Instance spawned successfully.
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:57:02 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412222.6920981, ca1b4132-15bd-4d4e-8d0c-d074824c888f => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:57:02 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] VM Started (Lifecycle Event)
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:02 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:57:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:57:03 user nova-compute[71692]: INFO nova.compute.manager [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Took 14.88 seconds to spawn the instance on the hypervisor.
Apr 13 18:57:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:57:03 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:57:03 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412222.8441188, b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:57:03 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] VM Resumed (Lifecycle Event)
Apr 13 18:57:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:57:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:57:03 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:57:03 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412222.8464503, b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:57:03 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] VM Started (Lifecycle Event)
Apr 13 18:57:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:57:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:57:03 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:57:03 user nova-compute[71692]: INFO nova.compute.manager [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Took 16.01 seconds to build instance.
Apr 13 18:57:03 user nova-compute[71692]: INFO nova.compute.manager [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Took 13.59 seconds to spawn the instance on the hypervisor.
Apr 13 18:57:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:57:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-816e9ff2-1d99-46f8-b8ba-2aad213314b7 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.140s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:03 user nova-compute[71692]: INFO nova.compute.manager [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Took 14.41 seconds to build instance.
Apr 13 18:57:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-070598d9-2931-42ca-97e4-1f5b798bd297 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.538s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "106da0b9-c823-4f26-874c-53f8ad235e61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "106da0b9-c823-4f26-874c-53f8ad235e61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:57:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:05 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:57:05 user nova-compute[71692]: INFO nova.compute.claims [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Claim successful on node user
Apr 13 18:57:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:05 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:57:05 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG nova.network.neutron [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:57:06 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:57:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:57:06 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Creating image(s)
Apr 13 18:57:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "/opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "/opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "/opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG nova.policy [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e1ffe2f879f4c049b6c28d3a9623d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d708f05aa7c454bbf94931b6b5593bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.190s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.155s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk 1073741824" returned: 0 in 0.084s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.173s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:07 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:57:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:07 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Cannot resize image /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:57:07 user nova-compute[71692]: DEBUG nova.objects.instance [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lazy-loading 'migration_context' on Instance uuid 106da0b9-c823-4f26-874c-53f8ad235e61 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:57:07 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:57:07 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Ensure instance console log exists: /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:57:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:08 user nova-compute[71692]: DEBUG nova.network.neutron [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Successfully created port: 8638d612-5f79-496f-8be2-db6706c14211 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:57:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "0ed13b57-30a9-44c2-a18d-f936d33209b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:57:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:08 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:57:08 user nova-compute[71692]: INFO nova.compute.claims [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Claim successful on node user
Apr 13 18:57:09 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:57:09 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:57:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.901s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:09 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:57:09 user nova-compute[71692]: DEBUG nova.network.neutron [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Successfully updated port: 8638d612-5f79-496f-8be2-db6706c14211 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:57:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "refresh_cache-106da0b9-c823-4f26-874c-53f8ad235e61" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:57:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquired lock "refresh_cache-106da0b9-c823-4f26-874c-53f8ad235e61" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:57:09 user nova-compute[71692]: DEBUG nova.network.neutron [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:57:09 user nova-compute[71692]: DEBUG nova.compute.manager [req-ecadaae9-c42a-4566-9181-47d2d44fc9d0 req-17ea7c6a-5f11-4fbf-80c9-c3c13fbd617b service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Received event network-changed-8638d612-5f79-496f-8be2-db6706c14211 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:09 user nova-compute[71692]: DEBUG nova.compute.manager [req-ecadaae9-c42a-4566-9181-47d2d44fc9d0 req-17ea7c6a-5f11-4fbf-80c9-c3c13fbd617b service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Refreshing instance network info cache due to event network-changed-8638d612-5f79-496f-8be2-db6706c14211. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:57:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ecadaae9-c42a-4566-9181-47d2d44fc9d0 req-17ea7c6a-5f11-4fbf-80c9-c3c13fbd617b service nova] Acquiring lock "refresh_cache-106da0b9-c823-4f26-874c-53f8ad235e61" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:57:09 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:57:09 user nova-compute[71692]: DEBUG nova.network.neutron [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:57:09 user nova-compute[71692]: DEBUG nova.network.neutron [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:57:09 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.policy [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfd7cd2f777f4101bc727349911ae5c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103d122466143fa96dabc7aec4c2b80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:57:10 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Creating image(s)
Apr 13 18:57:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "/opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "/opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "4ac7883f092fa9c8db44ed7fc999352860be33cb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "4ac7883f092fa9c8db44ed7fc999352860be33cb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb.part --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.network.neutron [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Updating instance_info_cache with network_info: [{"id": "8638d612-5f79-496f-8be2-db6706c14211", "address": "fa:16:3e:c4:f2:9f", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8638d612-5f", "ovs_interfaceid": "8638d612-5f79-496f-8be2-db6706c14211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb.part --force-share --output=json" returned: 0 in 0.178s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.images [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 277fa2a8-beff-4b89-80f3-69462dbc910b was qcow2, converting to raw {{(pid=71692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.privsep.utils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb.part /opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb.converted {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Releasing lock "refresh_cache-106da0b9-c823-4f26-874c-53f8ad235e61" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Instance network_info: |[{"id": "8638d612-5f79-496f-8be2-db6706c14211", "address": "fa:16:3e:c4:f2:9f", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8638d612-5f", "ovs_interfaceid": "8638d612-5f79-496f-8be2-db6706c14211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ecadaae9-c42a-4566-9181-47d2d44fc9d0 req-17ea7c6a-5f11-4fbf-80c9-c3c13fbd617b service nova] Acquired lock "refresh_cache-106da0b9-c823-4f26-874c-53f8ad235e61" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.network.neutron [req-ecadaae9-c42a-4566-9181-47d2d44fc9d0 req-17ea7c6a-5f11-4fbf-80c9-c3c13fbd617b service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Refreshing network info cache for port 8638d612-5f79-496f-8be2-db6706c14211 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Start _get_guest_xml network_info=[{"id": "8638d612-5f79-496f-8be2-db6706c14211", "address": "fa:16:3e:c4:f2:9f", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8638d612-5f", "ovs_interfaceid": "8638d612-5f79-496f-8be2-db6706c14211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:57:10 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:57:10 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-970620856',display_name='tempest-VolumesAdminNegativeTest-server-970620856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-970620856',id=6,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNx53/4TAraZymj7hPrAueoIiB2h+tK9tJDIWTVO4FAoZl6flYUlpNu57v9Udep5R3j5i9IphipgPVjtpSkbuoKv5VddMP6Q71wMlIc9GvORV54fC9iVQJ3MPfVXY9S2Ow==',key_name='tempest-keypair-2099795213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d708f05aa7c454bbf94931b6b5593bf',ramdisk_id='',reservation_id='r-owrg3nbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-947401316',owner_user_name='tempest-VolumesAdminNegativeTest-947401316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e1ffe2f879f4c049b6c28d3a9623d14',uuid=106da0b9-c823-4f26-874c-53f8ad235e61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8638d612-5f79-496f-8be2-db6706c14211", "address": "fa:16:3e:c4:f2:9f", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8638d612-5f", "ovs_interfaceid": "8638d612-5f79-496f-8be2-db6706c14211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Converting VIF {"id": "8638d612-5f79-496f-8be2-db6706c14211", "address": "fa:16:3e:c4:f2:9f", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8638d612-5f", "ovs_interfaceid": "8638d612-5f79-496f-8be2-db6706c14211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:f2:9f,bridge_name='br-int',has_traffic_filtering=True,id=8638d612-5f79-496f-8be2-db6706c14211,network=Network(99569b6e-2d6c-4e03-9971-462e962f316f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8638d612-5f') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.objects.instance [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lazy-loading 'pci_devices' on Instance uuid 106da0b9-c823-4f26-874c-53f8ad235e61 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:57:10 user nova-compute[71692]:   <uuid>106da0b9-c823-4f26-874c-53f8ad235e61</uuid>
Apr 13 18:57:10 user nova-compute[71692]:   <name>instance-00000006</name>
Apr 13 18:57:10 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 18:57:10 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 18:57:10 user nova-compute[71692]:   <metadata>
Apr 13 18:57:10 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:57:10 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 18:57:10 user nova-compute[71692]:       <nova:name>tempest-VolumesAdminNegativeTest-server-970620856</nova:name>
Apr 13 18:57:10 user nova-compute[71692]:       <nova:creationTime>2023-04-13 18:57:10</nova:creationTime>
Apr 13 18:57:10 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 18:57:10 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 18:57:10 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 18:57:10 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 18:57:10 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:57:10 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:57:10 user nova-compute[71692]:       </nova:flavor>
Apr 13 18:57:10 user nova-compute[71692]:       <nova:owner>
Apr 13 18:57:10 user nova-compute[71692]:         <nova:user uuid="3e1ffe2f879f4c049b6c28d3a9623d14">tempest-VolumesAdminNegativeTest-947401316-project-member</nova:user>
Apr 13 18:57:10 user nova-compute[71692]:         <nova:project uuid="0d708f05aa7c454bbf94931b6b5593bf">tempest-VolumesAdminNegativeTest-947401316</nova:project>
Apr 13 18:57:10 user nova-compute[71692]:       </nova:owner>
Apr 13 18:57:10 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 18:57:10 user nova-compute[71692]:       <nova:ports>
Apr 13 18:57:10 user nova-compute[71692]:         <nova:port uuid="8638d612-5f79-496f-8be2-db6706c14211">
Apr 13 18:57:10 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 18:57:10 user nova-compute[71692]:         </nova:port>
Apr 13 18:57:10 user nova-compute[71692]:       </nova:ports>
Apr 13 18:57:10 user nova-compute[71692]:     </nova:instance>
Apr 13 18:57:10 user nova-compute[71692]:   </metadata>
Apr 13 18:57:10 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 18:57:10 user nova-compute[71692]:     <system>
Apr 13 18:57:10 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:57:10 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:57:10 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 18:57:10 user nova-compute[71692]:       <entry name="serial">106da0b9-c823-4f26-874c-53f8ad235e61</entry>
Apr 13 18:57:10 user nova-compute[71692]:       <entry name="uuid">106da0b9-c823-4f26-874c-53f8ad235e61</entry>
Apr 13 18:57:10 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:57:10 user nova-compute[71692]:     </system>
Apr 13 18:57:10 user nova-compute[71692]:   </sysinfo>
Apr 13 18:57:10 user nova-compute[71692]:   <os>
Apr 13 18:57:10 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:57:10 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 18:57:10 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 18:57:10 user nova-compute[71692]:   </os>
Apr 13 18:57:10 user nova-compute[71692]:   <features>
Apr 13 18:57:10 user nova-compute[71692]:     <acpi/>
Apr 13 18:57:10 user nova-compute[71692]:     <apic/>
Apr 13 18:57:10 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 18:57:10 user nova-compute[71692]:   </features>
Apr 13 18:57:10 user nova-compute[71692]:   <clock offset="utc">
Apr 13 18:57:10 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:57:10 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:57:10 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 18:57:10 user nova-compute[71692]:   </clock>
Apr 13 18:57:10 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 18:57:10 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 18:57:10 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:57:10 user nova-compute[71692]:   </cpu>
Apr 13 18:57:10 user nova-compute[71692]:   <devices>
Apr 13 18:57:10 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 18:57:10 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:57:10 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk"/>
Apr 13 18:57:10 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 18:57:10 user nova-compute[71692]:     </disk>
Apr 13 18:57:10 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 18:57:10 user nova-compute[71692]:       <mac address="fa:16:3e:c4:f2:9f"/>
Apr 13 18:57:10 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:57:10 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 18:57:10 user nova-compute[71692]:       <target dev="tap8638d612-5f"/>
Apr 13 18:57:10 user nova-compute[71692]:     </interface>
Apr 13 18:57:10 user nova-compute[71692]:     <serial type="pty">
Apr 13 18:57:10 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/console.log" append="off"/>
Apr 13 18:57:10 user nova-compute[71692]:     </serial>
Apr 13 18:57:10 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:57:10 user nova-compute[71692]:     <video>
Apr 13 18:57:10 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:57:10 user nova-compute[71692]:     </video>
Apr 13 18:57:10 user nova-compute[71692]:     <rng model="virtio">
Apr 13 18:57:10 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:57:10 user nova-compute[71692]:     </rng>
Apr 13 18:57:10 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:57:10 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 18:57:10 user nova-compute[71692]:       <stats period="10"/>
Apr 13 18:57:10 user nova-compute[71692]:     </memballoon>
Apr 13 18:57:10 user nova-compute[71692]:   </devices>
Apr 13 18:57:10 user nova-compute[71692]: </domain>
Apr 13 18:57:10 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-970620856',display_name='tempest-VolumesAdminNegativeTest-server-970620856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-970620856',id=6,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNx53/4TAraZymj7hPrAueoIiB2h+tK9tJDIWTVO4FAoZl6flYUlpNu57v9Udep5R3j5i9IphipgPVjtpSkbuoKv5VddMP6Q71wMlIc9GvORV54fC9iVQJ3MPfVXY9S2Ow==',key_name='tempest-keypair-2099795213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d708f05aa7c454bbf94931b6b5593bf',ramdisk_id='',reservation_id='r-owrg3nbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-947401316',owner_user_name='tempest-VolumesAdminNegativeTest-947401316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e1ffe2f879f4c049b6c28d3a9623d14',uuid=106da0b9-c823-4f26-874c-53f8ad235e61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8638d612-5f79-496f-8be2-db6706c14211", "address": "fa:16:3e:c4:f2:9f", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8638d612-5f", "ovs_interfaceid": "8638d612-5f79-496f-8be2-db6706c14211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Converting VIF {"id": "8638d612-5f79-496f-8be2-db6706c14211", "address": "fa:16:3e:c4:f2:9f", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8638d612-5f", "ovs_interfaceid": "8638d612-5f79-496f-8be2-db6706c14211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:f2:9f,bridge_name='br-int',has_traffic_filtering=True,id=8638d612-5f79-496f-8be2-db6706c14211,network=Network(99569b6e-2d6c-4e03-9971-462e962f316f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8638d612-5f') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG os_vif [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:f2:9f,bridge_name='br-int',has_traffic_filtering=True,id=8638d612-5f79-496f-8be2-db6706c14211,network=Network(99569b6e-2d6c-4e03-9971-462e962f316f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8638d612-5f') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:57:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8638d612-5f, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8638d612-5f, col_values=(('external_ids', {'iface-id': '8638d612-5f79-496f-8be2-db6706c14211', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:f2:9f', 'vm-uuid': '106da0b9-c823-4f26-874c-53f8ad235e61'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb.part /opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb.converted" returned: 0 in 0.227s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb.converted --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:11 user nova-compute[71692]: INFO os_vif [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:f2:9f,bridge_name='br-int',has_traffic_filtering=True,id=8638d612-5f79-496f-8be2-db6706c14211,network=Network(99569b6e-2d6c-4e03-9971-462e962f316f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8638d612-5f')
Apr 13 18:57:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] No VIF found with MAC fa:16:3e:c4:f2:9f, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "4ac7883f092fa9c8db44ed7fc999352860be33cb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.970s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG nova.network.neutron [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Successfully created port: e1757463-6986-4a9e-938a-9960bbe17cb9 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb --force-share --output=json" returned: 0 in 0.212s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "4ac7883f092fa9c8db44ed7fc999352860be33cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "4ac7883f092fa9c8db44ed7fc999352860be33cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb --force-share --output=json" returned: 0 in 0.146s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb,backing_fmt=raw /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb,backing_fmt=raw /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk 1073741824" returned: 0 in 0.057s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "4ac7883f092fa9c8db44ed7fc999352860be33cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG nova.network.neutron [req-ecadaae9-c42a-4566-9181-47d2d44fc9d0 req-17ea7c6a-5f11-4fbf-80c9-c3c13fbd617b service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Updated VIF entry in instance network info cache for port 8638d612-5f79-496f-8be2-db6706c14211. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG nova.network.neutron [req-ecadaae9-c42a-4566-9181-47d2d44fc9d0 req-17ea7c6a-5f11-4fbf-80c9-c3c13fbd617b service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Updating instance_info_cache with network_info: [{"id": "8638d612-5f79-496f-8be2-db6706c14211", "address": "fa:16:3e:c4:f2:9f", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8638d612-5f", "ovs_interfaceid": "8638d612-5f79-496f-8be2-db6706c14211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ecadaae9-c42a-4566-9181-47d2d44fc9d0 req-17ea7c6a-5f11-4fbf-80c9-c3c13fbd617b service nova] Releasing lock "refresh_cache-106da0b9-c823-4f26-874c-53f8ad235e61" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb --force-share --output=json" returned: 0 in 0.161s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "570101b9-9c60-4c05-94ab-437a8a07d453" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "570101b9-9c60-4c05-94ab-437a8a07d453" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Cannot resize image /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG nova.objects.instance [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lazy-loading 'migration_context' on Instance uuid 0ed13b57-30a9-44c2-a18d-f936d33209b0 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Ensure instance console log exists: /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:57:12 user nova-compute[71692]: INFO nova.compute.claims [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Claim successful on node user
Apr 13 18:57:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Successfully updated port: e1757463-6986-4a9e-938a-9960bbe17cb9 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-33646240-e4fd-46a2-84e1-35b903c9fcb0 req-086f05f3-af50-41a9-9092-84e83028f838 service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Received event network-changed-e1757463-6986-4a9e-938a-9960bbe17cb9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-33646240-e4fd-46a2-84e1-35b903c9fcb0 req-086f05f3-af50-41a9-9092-84e83028f838 service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Refreshing instance network info cache due to event network-changed-e1757463-6986-4a9e-938a-9960bbe17cb9. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-33646240-e4fd-46a2-84e1-35b903c9fcb0 req-086f05f3-af50-41a9-9092-84e83028f838 service nova] Acquiring lock "refresh_cache-0ed13b57-30a9-44c2-a18d-f936d33209b0" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-33646240-e4fd-46a2-84e1-35b903c9fcb0 req-086f05f3-af50-41a9-9092-84e83028f838 service nova] Acquired lock "refresh_cache-0ed13b57-30a9-44c2-a18d-f936d33209b0" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG nova.network.neutron [req-33646240-e4fd-46a2-84e1-35b903c9fcb0 req-086f05f3-af50-41a9-9092-84e83028f838 service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Refreshing network info cache for port e1757463-6986-4a9e-938a-9960bbe17cb9 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "refresh_cache-0ed13b57-30a9-44c2-a18d-f936d33209b0" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG nova.network.neutron [req-33646240-e4fd-46a2-84e1-35b903c9fcb0 req-086f05f3-af50-41a9-9092-84e83028f838 service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:12 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:57:12 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG nova.policy [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ff89f9a33e348e69d8a7e986100d421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc420cebeb8945cea96fe22173ad2b5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG nova.network.neutron [req-33646240-e4fd-46a2-84e1-35b903c9fcb0 req-086f05f3-af50-41a9-9092-84e83028f838 service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:57:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-33646240-e4fd-46a2-84e1-35b903c9fcb0 req-086f05f3-af50-41a9-9092-84e83028f838 service nova] Releasing lock "refresh_cache-0ed13b57-30a9-44c2-a18d-f936d33209b0" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquired lock "refresh_cache-0ed13b57-30a9-44c2-a18d-f936d33209b0" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG nova.network.neutron [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:57:13 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Creating image(s)
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "/opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "/opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "/opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG nova.network.neutron [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-0ab1bc99-836a-44d7-8f2d-632b1920529f req-3851530f-32e8-47ec-875b-f155f781b2d7 service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Received event network-vif-plugged-8638d612-5f79-496f-8be2-db6706c14211 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0ab1bc99-836a-44d7-8f2d-632b1920529f req-3851530f-32e8-47ec-875b-f155f781b2d7 service nova] Acquiring lock "106da0b9-c823-4f26-874c-53f8ad235e61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0ab1bc99-836a-44d7-8f2d-632b1920529f req-3851530f-32e8-47ec-875b-f155f781b2d7 service nova] Lock "106da0b9-c823-4f26-874c-53f8ad235e61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0ab1bc99-836a-44d7-8f2d-632b1920529f req-3851530f-32e8-47ec-875b-f155f781b2d7 service nova] Lock "106da0b9-c823-4f26-874c-53f8ad235e61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-0ab1bc99-836a-44d7-8f2d-632b1920529f req-3851530f-32e8-47ec-875b-f155f781b2d7 service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] No waiting events found dispatching network-vif-plugged-8638d612-5f79-496f-8be2-db6706c14211 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:57:13 user nova-compute[71692]: WARNING nova.compute.manager [req-0ab1bc99-836a-44d7-8f2d-632b1920529f req-3851530f-32e8-47ec-875b-f155f781b2d7 service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Received unexpected event network-vif-plugged-8638d612-5f79-496f-8be2-db6706c14211 for instance with vm_state building and task_state spawning.
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.200s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.170s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk 1073741824" returned: 0 in 0.066s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.224s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Checking if we can resize image /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Cannot resize image /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lazy-loading 'migration_context' on Instance uuid 570101b9-9c60-4c05-94ab-437a8a07d453 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG nova.network.neutron [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Updating instance_info_cache with network_info: [{"id": "e1757463-6986-4a9e-938a-9960bbe17cb9", "address": "fa:16:3e:a9:06:fa", "network": {"id": "183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1861706338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a103d122466143fa96dabc7aec4c2b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1757463-69", "ovs_interfaceid": "e1757463-6986-4a9e-938a-9960bbe17cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Ensure instance console log exists: /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Releasing lock "refresh_cache-0ed13b57-30a9-44c2-a18d-f936d33209b0" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Instance network_info: |[{"id": "e1757463-6986-4a9e-938a-9960bbe17cb9", "address": "fa:16:3e:a9:06:fa", "network": {"id": "183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1861706338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a103d122466143fa96dabc7aec4c2b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1757463-69", "ovs_interfaceid": "e1757463-6986-4a9e-938a-9960bbe17cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:57:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Start _get_guest_xml network_info=[{"id": "e1757463-6986-4a9e-938a-9960bbe17cb9", "address": "fa:16:3e:a9:06:fa", "network": {"id": "183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1861706338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a103d122466143fa96dabc7aec4c2b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1757463-69", "ovs_interfaceid": "e1757463-6986-4a9e-938a-9960bbe17cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:56:58Z,direct_url=<?>,disk_format='qcow2',id=277fa2a8-beff-4b89-80f3-69462dbc910b,min_disk=0,min_ram=0,name='',owner='1daf25584e614a079139b7841c5e55cd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:57:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': '277fa2a8-beff-4b89-80f3-69462dbc910b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:57:14 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:57:14 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:56:58Z,direct_url=<?>,disk_format='qcow2',id=277fa2a8-beff-4b89-80f3-69462dbc910b,min_disk=0,min_ram=0,name='',owner='1daf25584e614a079139b7841c5e55cd',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:57:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-725397932',display_name='tempest-AttachSCSIVolumeTestJSON-server-725397932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-725397932',id=7,image_ref='277fa2a8-beff-4b89-80f3-69462dbc910b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOZw12y7JvN6iF5rvKpcO6rMNM7Ywi+ISHUKbndrEzQqj2J1+o6PLYpYgMYAzLmFd1Mu6qfqZLcgvarOntymA742YPlT0hQA2ze5D9iB8PHU56r5M+SfrjbYL32Z9e3dQ==',key_name='tempest-keypair-1173318920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a103d122466143fa96dabc7aec4c2b80',ramdisk_id='',reservation_id='r-xq5b9vzn',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='277fa2a8-beff-4b89-80f3-69462dbc910b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-655554039',owner_user_name='tempest-AttachSCSIVolumeTestJSON-655554039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfd7cd2f777f4101bc727349911ae5c3',uuid=0ed13b57-30a9-44c2-a18d-f936d33209b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1757463-6986-4a9e-938a-9960bbe17cb9", "address": "fa:16:3e:a9:06:fa", "network": {"id": "183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1861706338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a103d122466143fa96dabc7aec4c2b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1757463-69", "ovs_interfaceid": "e1757463-6986-4a9e-938a-9960bbe17cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Converting VIF {"id": "e1757463-6986-4a9e-938a-9960bbe17cb9", "address": "fa:16:3e:a9:06:fa", "network": {"id": "183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1861706338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a103d122466143fa96dabc7aec4c2b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1757463-69", "ovs_interfaceid": "e1757463-6986-4a9e-938a-9960bbe17cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:06:fa,bridge_name='br-int',has_traffic_filtering=True,id=e1757463-6986-4a9e-938a-9960bbe17cb9,network=Network(183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1757463-69') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.objects.instance [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ed13b57-30a9-44c2-a18d-f936d33209b0 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:57:14 user nova-compute[71692]:   <uuid>0ed13b57-30a9-44c2-a18d-f936d33209b0</uuid>
Apr 13 18:57:14 user nova-compute[71692]:   <name>instance-00000007</name>
Apr 13 18:57:14 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 18:57:14 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 18:57:14 user nova-compute[71692]:   <metadata>
Apr 13 18:57:14 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:57:14 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 18:57:14 user nova-compute[71692]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-725397932</nova:name>
Apr 13 18:57:14 user nova-compute[71692]:       <nova:creationTime>2023-04-13 18:57:14</nova:creationTime>
Apr 13 18:57:14 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 18:57:14 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 18:57:14 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 18:57:14 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 18:57:14 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:57:14 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:57:14 user nova-compute[71692]:       </nova:flavor>
Apr 13 18:57:14 user nova-compute[71692]:       <nova:owner>
Apr 13 18:57:14 user nova-compute[71692]:         <nova:user uuid="bfd7cd2f777f4101bc727349911ae5c3">tempest-AttachSCSIVolumeTestJSON-655554039-project-member</nova:user>
Apr 13 18:57:14 user nova-compute[71692]:         <nova:project uuid="a103d122466143fa96dabc7aec4c2b80">tempest-AttachSCSIVolumeTestJSON-655554039</nova:project>
Apr 13 18:57:14 user nova-compute[71692]:       </nova:owner>
Apr 13 18:57:14 user nova-compute[71692]:       <nova:root type="image" uuid="277fa2a8-beff-4b89-80f3-69462dbc910b"/>
Apr 13 18:57:14 user nova-compute[71692]:       <nova:ports>
Apr 13 18:57:14 user nova-compute[71692]:         <nova:port uuid="e1757463-6986-4a9e-938a-9960bbe17cb9">
Apr 13 18:57:14 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 18:57:14 user nova-compute[71692]:         </nova:port>
Apr 13 18:57:14 user nova-compute[71692]:       </nova:ports>
Apr 13 18:57:14 user nova-compute[71692]:     </nova:instance>
Apr 13 18:57:14 user nova-compute[71692]:   </metadata>
Apr 13 18:57:14 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 18:57:14 user nova-compute[71692]:     <system>
Apr 13 18:57:14 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:57:14 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:57:14 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 18:57:14 user nova-compute[71692]:       <entry name="serial">0ed13b57-30a9-44c2-a18d-f936d33209b0</entry>
Apr 13 18:57:14 user nova-compute[71692]:       <entry name="uuid">0ed13b57-30a9-44c2-a18d-f936d33209b0</entry>
Apr 13 18:57:14 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:57:14 user nova-compute[71692]:     </system>
Apr 13 18:57:14 user nova-compute[71692]:   </sysinfo>
Apr 13 18:57:14 user nova-compute[71692]:   <os>
Apr 13 18:57:14 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:57:14 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 18:57:14 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 18:57:14 user nova-compute[71692]:   </os>
Apr 13 18:57:14 user nova-compute[71692]:   <features>
Apr 13 18:57:14 user nova-compute[71692]:     <acpi/>
Apr 13 18:57:14 user nova-compute[71692]:     <apic/>
Apr 13 18:57:14 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 18:57:14 user nova-compute[71692]:   </features>
Apr 13 18:57:14 user nova-compute[71692]:   <clock offset="utc">
Apr 13 18:57:14 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:57:14 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:57:14 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 18:57:14 user nova-compute[71692]:   </clock>
Apr 13 18:57:14 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 18:57:14 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 18:57:14 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:57:14 user nova-compute[71692]:   </cpu>
Apr 13 18:57:14 user nova-compute[71692]:   <devices>
Apr 13 18:57:14 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 18:57:14 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:57:14 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk"/>
Apr 13 18:57:14 user nova-compute[71692]:       <target dev="sda" bus="scsi"/>
Apr 13 18:57:14 user nova-compute[71692]:       <address type="drive" controller="0" unit="0"/>
Apr 13 18:57:14 user nova-compute[71692]:     </disk>
Apr 13 18:57:14 user nova-compute[71692]:     <disk type="file" device="cdrom">
Apr 13 18:57:14 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 18:57:14 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk.config"/>
Apr 13 18:57:14 user nova-compute[71692]:       <target dev="sdb" bus="scsi"/>
Apr 13 18:57:14 user nova-compute[71692]:       <address type="drive" controller="0" unit="1"/>
Apr 13 18:57:14 user nova-compute[71692]:     </disk>
Apr 13 18:57:14 user nova-compute[71692]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 13 18:57:14 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 18:57:14 user nova-compute[71692]:       <mac address="fa:16:3e:a9:06:fa"/>
Apr 13 18:57:14 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:57:14 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 18:57:14 user nova-compute[71692]:       <target dev="tape1757463-69"/>
Apr 13 18:57:14 user nova-compute[71692]:     </interface>
Apr 13 18:57:14 user nova-compute[71692]:     <serial type="pty">
Apr 13 18:57:14 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/console.log" append="off"/>
Apr 13 18:57:14 user nova-compute[71692]:     </serial>
Apr 13 18:57:14 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:57:14 user nova-compute[71692]:     <video>
Apr 13 18:57:14 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:57:14 user nova-compute[71692]:     </video>
Apr 13 18:57:14 user nova-compute[71692]:     <rng model="virtio">
Apr 13 18:57:14 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:57:14 user nova-compute[71692]:     </rng>
Apr 13 18:57:14 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:57:14 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 18:57:14 user nova-compute[71692]:       <stats period="10"/>
Apr 13 18:57:14 user nova-compute[71692]:     </memballoon>
Apr 13 18:57:14 user nova-compute[71692]:   </devices>
Apr 13 18:57:14 user nova-compute[71692]: </domain>
Apr 13 18:57:14 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-725397932',display_name='tempest-AttachSCSIVolumeTestJSON-server-725397932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-725397932',id=7,image_ref='277fa2a8-beff-4b89-80f3-69462dbc910b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOZw12y7JvN6iF5rvKpcO6rMNM7Ywi+ISHUKbndrEzQqj2J1+o6PLYpYgMYAzLmFd1Mu6qfqZLcgvarOntymA742YPlT0hQA2ze5D9iB8PHU56r5M+SfrjbYL32Z9e3dQ==',key_name='tempest-keypair-1173318920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a103d122466143fa96dabc7aec4c2b80',ramdisk_id='',reservation_id='r-xq5b9vzn',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='277fa2a8-beff-4b89-80f3-69462dbc910b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-655554039',owner_user_name='tempest-AttachSCSIVolumeTestJSON-655554039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfd7cd2f777f4101bc727349911ae5c3',uuid=0ed13b57-30a9-44c2-a18d-f936d33209b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1757463-6986-4a9e-938a-9960bbe17cb9", "address": "fa:16:3e:a9:06:fa", "network": {"id": "183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1861706338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a103d122466143fa96dabc7aec4c2b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1757463-69", "ovs_interfaceid": "e1757463-6986-4a9e-938a-9960bbe17cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Converting VIF {"id": "e1757463-6986-4a9e-938a-9960bbe17cb9", "address": "fa:16:3e:a9:06:fa", "network": {"id": "183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1861706338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a103d122466143fa96dabc7aec4c2b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1757463-69", "ovs_interfaceid": "e1757463-6986-4a9e-938a-9960bbe17cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:06:fa,bridge_name='br-int',has_traffic_filtering=True,id=e1757463-6986-4a9e-938a-9960bbe17cb9,network=Network(183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1757463-69') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG os_vif [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:06:fa,bridge_name='br-int',has_traffic_filtering=True,id=e1757463-6986-4a9e-938a-9960bbe17cb9,network=Network(183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1757463-69') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1757463-69, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape1757463-69, col_values=(('external_ids', {'iface-id': 'e1757463-6986-4a9e-938a-9960bbe17cb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:06:fa', 'vm-uuid': '0ed13b57-30a9-44c2-a18d-f936d33209b0'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:14 user nova-compute[71692]: INFO os_vif [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:06:fa,bridge_name='br-int',has_traffic_filtering=True,id=e1757463-6986-4a9e-938a-9960bbe17cb9,network=Network(183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1757463-69')
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] No BDM found with device name sda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] No VIF found with MAC fa:16:3e:a9:06:fa, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:57:14 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Using config drive
Apr 13 18:57:14 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Successfully created port: 3e432daf-10a6-4797-b1f8-ad67a2b8417f {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:57:14 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Creating config drive at /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk.config
Apr 13 18:57:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5hh_9y5n {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5hh_9y5n" returned: 0 in 0.076s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Successfully updated port: 3e432daf-10a6-4797-b1f8-ad67a2b8417f {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-647539e8-5b4d-4e22-ba19-399e9c55ac51 req-ce43f2a2-66b1-4f5f-96a5-6a0227b621a5 service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Received event network-vif-plugged-8638d612-5f79-496f-8be2-db6706c14211 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-647539e8-5b4d-4e22-ba19-399e9c55ac51 req-ce43f2a2-66b1-4f5f-96a5-6a0227b621a5 service nova] Acquiring lock "106da0b9-c823-4f26-874c-53f8ad235e61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-647539e8-5b4d-4e22-ba19-399e9c55ac51 req-ce43f2a2-66b1-4f5f-96a5-6a0227b621a5 service nova] Lock "106da0b9-c823-4f26-874c-53f8ad235e61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-647539e8-5b4d-4e22-ba19-399e9c55ac51 req-ce43f2a2-66b1-4f5f-96a5-6a0227b621a5 service nova] Lock "106da0b9-c823-4f26-874c-53f8ad235e61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-647539e8-5b4d-4e22-ba19-399e9c55ac51 req-ce43f2a2-66b1-4f5f-96a5-6a0227b621a5 service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] No waiting events found dispatching network-vif-plugged-8638d612-5f79-496f-8be2-db6706c14211 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:57:15 user nova-compute[71692]: WARNING nova.compute.manager [req-647539e8-5b4d-4e22-ba19-399e9c55ac51 req-ce43f2a2-66b1-4f5f-96a5-6a0227b621a5 service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Received unexpected event network-vif-plugged-8638d612-5f79-496f-8be2-db6706c14211 for instance with vm_state building and task_state spawning.
Apr 13 18:57:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "refresh_cache-570101b9-9c60-4c05-94ab-437a8a07d453" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquired lock "refresh_cache-570101b9-9c60-4c05-94ab-437a8a07d453" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412235.7515512, 106da0b9-c823-4f26-874c-53f8ad235e61 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:57:15 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] VM Resumed (Lifecycle Event)
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Updating instance_info_cache with network_info: [{"id": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "address": "fa:16:3e:2f:62:f1", "network": {"id": "c63ad37e-6185-435b-bc54-f9a888e474bd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-679119519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc420cebeb8945cea96fe22173ad2b5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e432daf-10", "ovs_interfaceid": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:57:15 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Instance spawned successfully.
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Releasing lock "refresh_cache-570101b9-9c60-4c05-94ab-437a8a07d453" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Instance network_info: |[{"id": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "address": "fa:16:3e:2f:62:f1", "network": {"id": "c63ad37e-6185-435b-bc54-f9a888e474bd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-679119519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc420cebeb8945cea96fe22173ad2b5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e432daf-10", "ovs_interfaceid": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Start _get_guest_xml network_info=[{"id": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "address": "fa:16:3e:2f:62:f1", "network": {"id": "c63ad37e-6185-435b-bc54-f9a888e474bd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-679119519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc420cebeb8945cea96fe22173ad2b5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e432daf-10", "ovs_interfaceid": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:15 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412235.752848, 106da0b9-c823-4f26-874c-53f8ad235e61 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:57:15 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] VM Started (Lifecycle Event)
Apr 13 18:57:15 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:57:15 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1559374833',display_name='tempest-TestVolumeSwap-server-1559374833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1559374833',id=8,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIHybbKbv7HB+poxM5bK6awPxAExJljIECejrWYDmeSfQmp6wCacJOP/VGUPmj5NG5bAbHqNGkaAPI2nHiqHCKbFPdHWi6SSD7AEztbj0Dk/6ervAhiyZ1/5WcBBSR/7Q==',key_name='tempest-keypair-1823176268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc420cebeb8945cea96fe22173ad2b5b',ramdisk_id='',reservation_id='r-mj240e1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-65519151',owner_user_name='tempest-TestVolumeSwap-65519151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ff89f9a33e348e69d8a7e986100d421',uuid=570101b9-9c60-4c05-94ab-437a8a07d453,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "address": "fa:16:3e:2f:62:f1", "network": {"id": "c63ad37e-6185-435b-bc54-f9a888e474bd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-679119519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc420cebeb8945cea96fe22173ad2b5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e432daf-10", "ovs_interfaceid": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Converting VIF {"id": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "address": "fa:16:3e:2f:62:f1", "network": {"id": "c63ad37e-6185-435b-bc54-f9a888e474bd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-679119519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc420cebeb8945cea96fe22173ad2b5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e432daf-10", "ovs_interfaceid": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:f1,bridge_name='br-int',has_traffic_filtering=True,id=3e432daf-10a6-4797-b1f8-ad67a2b8417f,network=Network(c63ad37e-6185-435b-bc54-f9a888e474bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e432daf-10') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lazy-loading 'pci_devices' on Instance uuid 570101b9-9c60-4c05-94ab-437a8a07d453 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:57:15 user nova-compute[71692]:   <uuid>570101b9-9c60-4c05-94ab-437a8a07d453</uuid>
Apr 13 18:57:15 user nova-compute[71692]:   <name>instance-00000008</name>
Apr 13 18:57:15 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 18:57:15 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 18:57:15 user nova-compute[71692]:   <metadata>
Apr 13 18:57:15 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:57:15 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 18:57:15 user nova-compute[71692]:       <nova:name>tempest-TestVolumeSwap-server-1559374833</nova:name>
Apr 13 18:57:15 user nova-compute[71692]:       <nova:creationTime>2023-04-13 18:57:15</nova:creationTime>
Apr 13 18:57:15 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 18:57:15 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 18:57:15 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 18:57:15 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 18:57:15 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:57:15 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:57:15 user nova-compute[71692]:       </nova:flavor>
Apr 13 18:57:15 user nova-compute[71692]:       <nova:owner>
Apr 13 18:57:15 user nova-compute[71692]:         <nova:user uuid="3ff89f9a33e348e69d8a7e986100d421">tempest-TestVolumeSwap-65519151-project-member</nova:user>
Apr 13 18:57:15 user nova-compute[71692]:         <nova:project uuid="dc420cebeb8945cea96fe22173ad2b5b">tempest-TestVolumeSwap-65519151</nova:project>
Apr 13 18:57:15 user nova-compute[71692]:       </nova:owner>
Apr 13 18:57:15 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 18:57:15 user nova-compute[71692]:       <nova:ports>
Apr 13 18:57:15 user nova-compute[71692]:         <nova:port uuid="3e432daf-10a6-4797-b1f8-ad67a2b8417f">
Apr 13 18:57:15 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 18:57:15 user nova-compute[71692]:         </nova:port>
Apr 13 18:57:15 user nova-compute[71692]:       </nova:ports>
Apr 13 18:57:15 user nova-compute[71692]:     </nova:instance>
Apr 13 18:57:15 user nova-compute[71692]:   </metadata>
Apr 13 18:57:15 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 18:57:15 user nova-compute[71692]:     <system>
Apr 13 18:57:15 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:57:15 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:57:15 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 18:57:15 user nova-compute[71692]:       <entry name="serial">570101b9-9c60-4c05-94ab-437a8a07d453</entry>
Apr 13 18:57:15 user nova-compute[71692]:       <entry name="uuid">570101b9-9c60-4c05-94ab-437a8a07d453</entry>
Apr 13 18:57:15 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:57:15 user nova-compute[71692]:     </system>
Apr 13 18:57:15 user nova-compute[71692]:   </sysinfo>
Apr 13 18:57:15 user nova-compute[71692]:   <os>
Apr 13 18:57:15 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:57:15 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 18:57:15 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 18:57:15 user nova-compute[71692]:   </os>
Apr 13 18:57:15 user nova-compute[71692]:   <features>
Apr 13 18:57:15 user nova-compute[71692]:     <acpi/>
Apr 13 18:57:15 user nova-compute[71692]:     <apic/>
Apr 13 18:57:15 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 18:57:15 user nova-compute[71692]:   </features>
Apr 13 18:57:15 user nova-compute[71692]:   <clock offset="utc">
Apr 13 18:57:15 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:57:15 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:57:15 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 18:57:15 user nova-compute[71692]:   </clock>
Apr 13 18:57:15 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 18:57:15 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 18:57:15 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:57:15 user nova-compute[71692]:   </cpu>
Apr 13 18:57:15 user nova-compute[71692]:   <devices>
Apr 13 18:57:15 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 18:57:15 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:57:15 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk"/>
Apr 13 18:57:15 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 18:57:15 user nova-compute[71692]:     </disk>
Apr 13 18:57:15 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 18:57:15 user nova-compute[71692]:       <mac address="fa:16:3e:2f:62:f1"/>
Apr 13 18:57:15 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:57:15 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 18:57:15 user nova-compute[71692]:       <target dev="tap3e432daf-10"/>
Apr 13 18:57:15 user nova-compute[71692]:     </interface>
Apr 13 18:57:15 user nova-compute[71692]:     <serial type="pty">
Apr 13 18:57:15 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/console.log" append="off"/>
Apr 13 18:57:15 user nova-compute[71692]:     </serial>
Apr 13 18:57:15 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:57:15 user nova-compute[71692]:     <video>
Apr 13 18:57:15 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:57:15 user nova-compute[71692]:     </video>
Apr 13 18:57:15 user nova-compute[71692]:     <rng model="virtio">
Apr 13 18:57:15 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:57:15 user nova-compute[71692]:     </rng>
Apr 13 18:57:15 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:57:15 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 18:57:15 user nova-compute[71692]:       <stats period="10"/>
Apr 13 18:57:15 user nova-compute[71692]:     </memballoon>
Apr 13 18:57:15 user nova-compute[71692]:   </devices>
Apr 13 18:57:15 user nova-compute[71692]: </domain>
Apr 13 18:57:15 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1559374833',display_name='tempest-TestVolumeSwap-server-1559374833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1559374833',id=8,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIHybbKbv7HB+poxM5bK6awPxAExJljIECejrWYDmeSfQmp6wCacJOP/VGUPmj5NG5bAbHqNGkaAPI2nHiqHCKbFPdHWi6SSD7AEztbj0Dk/6ervAhiyZ1/5WcBBSR/7Q==',key_name='tempest-keypair-1823176268',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc420cebeb8945cea96fe22173ad2b5b',ramdisk_id='',reservation_id='r-mj240e1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-65519151',owner_user_name='tempest-TestVolumeSwap-65519151-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ff89f9a33e348e69d8a7e986100d421',uuid=570101b9-9c60-4c05-94ab-437a8a07d453,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "address": "fa:16:3e:2f:62:f1", "network": {"id": "c63ad37e-6185-435b-bc54-f9a888e474bd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-679119519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc420cebeb8945cea96fe22173ad2b5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e432daf-10", "ovs_interfaceid": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Converting VIF {"id": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "address": "fa:16:3e:2f:62:f1", "network": {"id": "c63ad37e-6185-435b-bc54-f9a888e474bd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-679119519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc420cebeb8945cea96fe22173ad2b5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e432daf-10", "ovs_interfaceid": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:f1,bridge_name='br-int',has_traffic_filtering=True,id=3e432daf-10a6-4797-b1f8-ad67a2b8417f,network=Network(c63ad37e-6185-435b-bc54-f9a888e474bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e432daf-10') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG os_vif [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:f1,bridge_name='br-int',has_traffic_filtering=True,id=3e432daf-10a6-4797-b1f8-ad67a2b8417f,network=Network(c63ad37e-6185-435b-bc54-f9a888e474bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e432daf-10') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e432daf-10, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e432daf-10, col_values=(('external_ids', {'iface-id': '3e432daf-10a6-4797-b1f8-ad67a2b8417f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:62:f1', 'vm-uuid': '570101b9-9c60-4c05-94ab-437a8a07d453'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:57:15 user nova-compute[71692]: INFO nova.compute.manager [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Took 9.58 seconds to spawn the instance on the hypervisor.
Apr 13 18:57:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:57:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:15 user nova-compute[71692]: INFO os_vif [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:f1,bridge_name='br-int',has_traffic_filtering=True,id=3e432daf-10a6-4797-b1f8-ad67a2b8417f,network=Network(c63ad37e-6185-435b-bc54-f9a888e474bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e432daf-10')
Apr 13 18:57:15 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:57:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:16 user nova-compute[71692]: INFO nova.compute.manager [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Took 10.74 seconds to build instance.
Apr 13 18:57:16 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:57:16 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] No VIF found with MAC fa:16:3e:2f:62:f1, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:57:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-65f3248e-ca0f-4cfe-8731-7c742909e29b tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "106da0b9-c823-4f26-874c-53f8ad235e61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.940s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-c579179e-7149-49bf-9565-e151c931733b req-a00c08c3-174b-401f-b357-15ed8cc0e88d service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Received event network-vif-plugged-e1757463-6986-4a9e-938a-9960bbe17cb9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c579179e-7149-49bf-9565-e151c931733b req-a00c08c3-174b-401f-b357-15ed8cc0e88d service nova] Acquiring lock "0ed13b57-30a9-44c2-a18d-f936d33209b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c579179e-7149-49bf-9565-e151c931733b req-a00c08c3-174b-401f-b357-15ed8cc0e88d service nova] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c579179e-7149-49bf-9565-e151c931733b req-a00c08c3-174b-401f-b357-15ed8cc0e88d service nova] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-c579179e-7149-49bf-9565-e151c931733b req-a00c08c3-174b-401f-b357-15ed8cc0e88d service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] No waiting events found dispatching network-vif-plugged-e1757463-6986-4a9e-938a-9960bbe17cb9 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:57:16 user nova-compute[71692]: WARNING nova.compute.manager [req-c579179e-7149-49bf-9565-e151c931733b req-a00c08c3-174b-401f-b357-15ed8cc0e88d service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Received unexpected event network-vif-plugged-e1757463-6986-4a9e-938a-9960bbe17cb9 for instance with vm_state building and task_state spawning.
Apr 13 18:57:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-6fc6e55c-5908-48b5-87ff-fe5af10b87b8 req-4ff9084d-16fc-4ab9-b3ae-7578501fb4c7 service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Received event network-changed-3e432daf-10a6-4797-b1f8-ad67a2b8417f {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-6fc6e55c-5908-48b5-87ff-fe5af10b87b8 req-4ff9084d-16fc-4ab9-b3ae-7578501fb4c7 service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Refreshing instance network info cache due to event network-changed-3e432daf-10a6-4797-b1f8-ad67a2b8417f. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:57:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6fc6e55c-5908-48b5-87ff-fe5af10b87b8 req-4ff9084d-16fc-4ab9-b3ae-7578501fb4c7 service nova] Acquiring lock "refresh_cache-570101b9-9c60-4c05-94ab-437a8a07d453" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:57:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6fc6e55c-5908-48b5-87ff-fe5af10b87b8 req-4ff9084d-16fc-4ab9-b3ae-7578501fb4c7 service nova] Acquired lock "refresh_cache-570101b9-9c60-4c05-94ab-437a8a07d453" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:57:17 user nova-compute[71692]: DEBUG nova.network.neutron [req-6fc6e55c-5908-48b5-87ff-fe5af10b87b8 req-4ff9084d-16fc-4ab9-b3ae-7578501fb4c7 service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Refreshing network info cache for port 3e432daf-10a6-4797-b1f8-ad67a2b8417f {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:57:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:18 user nova-compute[71692]: DEBUG nova.network.neutron [req-6fc6e55c-5908-48b5-87ff-fe5af10b87b8 req-4ff9084d-16fc-4ab9-b3ae-7578501fb4c7 service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Updated VIF entry in instance network info cache for port 3e432daf-10a6-4797-b1f8-ad67a2b8417f. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:57:18 user nova-compute[71692]: DEBUG nova.network.neutron [req-6fc6e55c-5908-48b5-87ff-fe5af10b87b8 req-4ff9084d-16fc-4ab9-b3ae-7578501fb4c7 service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Updating instance_info_cache with network_info: [{"id": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "address": "fa:16:3e:2f:62:f1", "network": {"id": "c63ad37e-6185-435b-bc54-f9a888e474bd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-679119519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc420cebeb8945cea96fe22173ad2b5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e432daf-10", "ovs_interfaceid": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:57:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6fc6e55c-5908-48b5-87ff-fe5af10b87b8 req-4ff9084d-16fc-4ab9-b3ae-7578501fb4c7 service nova] Releasing lock "refresh_cache-570101b9-9c60-4c05-94ab-437a8a07d453" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:57:18 user nova-compute[71692]: DEBUG nova.compute.manager [req-6fd62ec6-8a5f-479f-85c0-46588c89797a req-793e4c66-ff10-4d9a-b729-2f63e8d7aace service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Received event network-vif-plugged-3e432daf-10a6-4797-b1f8-ad67a2b8417f {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6fd62ec6-8a5f-479f-85c0-46588c89797a req-793e4c66-ff10-4d9a-b729-2f63e8d7aace service nova] Acquiring lock "570101b9-9c60-4c05-94ab-437a8a07d453-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6fd62ec6-8a5f-479f-85c0-46588c89797a req-793e4c66-ff10-4d9a-b729-2f63e8d7aace service nova] Lock "570101b9-9c60-4c05-94ab-437a8a07d453-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6fd62ec6-8a5f-479f-85c0-46588c89797a req-793e4c66-ff10-4d9a-b729-2f63e8d7aace service nova] Lock "570101b9-9c60-4c05-94ab-437a8a07d453-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:18 user nova-compute[71692]: DEBUG nova.compute.manager [req-6fd62ec6-8a5f-479f-85c0-46588c89797a req-793e4c66-ff10-4d9a-b729-2f63e8d7aace service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] No waiting events found dispatching network-vif-plugged-3e432daf-10a6-4797-b1f8-ad67a2b8417f {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:57:18 user nova-compute[71692]: WARNING nova.compute.manager [req-6fd62ec6-8a5f-479f-85c0-46588c89797a req-793e4c66-ff10-4d9a-b729-2f63e8d7aace service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Received unexpected event network-vif-plugged-3e432daf-10a6-4797-b1f8-ad67a2b8417f for instance with vm_state building and task_state spawning.
Apr 13 18:57:18 user nova-compute[71692]: DEBUG nova.compute.manager [req-fbe4897b-7763-44c8-bd87-f16c580470e9 req-342051f0-3b8d-4885-a069-7051cdd2a18e service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Received event network-vif-plugged-e1757463-6986-4a9e-938a-9960bbe17cb9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-fbe4897b-7763-44c8-bd87-f16c580470e9 req-342051f0-3b8d-4885-a069-7051cdd2a18e service nova] Acquiring lock "0ed13b57-30a9-44c2-a18d-f936d33209b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-fbe4897b-7763-44c8-bd87-f16c580470e9 req-342051f0-3b8d-4885-a069-7051cdd2a18e service nova] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-fbe4897b-7763-44c8-bd87-f16c580470e9 req-342051f0-3b8d-4885-a069-7051cdd2a18e service nova] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:18 user nova-compute[71692]: DEBUG nova.compute.manager [req-fbe4897b-7763-44c8-bd87-f16c580470e9 req-342051f0-3b8d-4885-a069-7051cdd2a18e service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] No waiting events found dispatching network-vif-plugged-e1757463-6986-4a9e-938a-9960bbe17cb9 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:57:18 user nova-compute[71692]: WARNING nova.compute.manager [req-fbe4897b-7763-44c8-bd87-f16c580470e9 req-342051f0-3b8d-4885-a069-7051cdd2a18e service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Received unexpected event network-vif-plugged-e1757463-6986-4a9e-938a-9960bbe17cb9 for instance with vm_state building and task_state spawning.
Apr 13 18:57:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412240.0277379, 0ed13b57-30a9-44c2-a18d-f936d33209b0 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:57:20 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] VM Resumed (Lifecycle Event)
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:57:20 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Instance spawned successfully.
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:57:20 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412240.028414, 0ed13b57-30a9-44c2-a18d-f936d33209b0 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:57:20 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] VM Started (Lifecycle Event)
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:57:20 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:57:20 user nova-compute[71692]: INFO nova.compute.manager [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Took 9.97 seconds to spawn the instance on the hypervisor.
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.compute.manager [req-86b35525-a902-41b9-8042-f040264556d8 req-07287edb-4db9-4e17-8356-18ccdb9f8eb8 service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Received event network-vif-plugged-3e432daf-10a6-4797-b1f8-ad67a2b8417f {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-86b35525-a902-41b9-8042-f040264556d8 req-07287edb-4db9-4e17-8356-18ccdb9f8eb8 service nova] Acquiring lock "570101b9-9c60-4c05-94ab-437a8a07d453-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-86b35525-a902-41b9-8042-f040264556d8 req-07287edb-4db9-4e17-8356-18ccdb9f8eb8 service nova] Lock "570101b9-9c60-4c05-94ab-437a8a07d453-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-86b35525-a902-41b9-8042-f040264556d8 req-07287edb-4db9-4e17-8356-18ccdb9f8eb8 service nova] Lock "570101b9-9c60-4c05-94ab-437a8a07d453-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.compute.manager [req-86b35525-a902-41b9-8042-f040264556d8 req-07287edb-4db9-4e17-8356-18ccdb9f8eb8 service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] No waiting events found dispatching network-vif-plugged-3e432daf-10a6-4797-b1f8-ad67a2b8417f {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:57:20 user nova-compute[71692]: WARNING nova.compute.manager [req-86b35525-a902-41b9-8042-f040264556d8 req-07287edb-4db9-4e17-8356-18ccdb9f8eb8 service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Received unexpected event network-vif-plugged-3e432daf-10a6-4797-b1f8-ad67a2b8417f for instance with vm_state building and task_state spawning.
Apr 13 18:57:20 user nova-compute[71692]: INFO nova.compute.manager [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Took 11.42 seconds to build instance.
Apr 13 18:57:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b17a1bb-2ec2-4e1b-904f-4e9318b0bb64 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.577s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412240.8553236, 570101b9-9c60-4c05-94ab-437a8a07d453 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:57:20 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] VM Resumed (Lifecycle Event)
Apr 13 18:57:20 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Instance spawned successfully.
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:57:20 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412240.8557293, 570101b9-9c60-4c05-94ab-437a8a07d453 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:57:20 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] VM Started (Lifecycle Event)
Apr 13 18:57:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:57:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:57:21 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:57:21 user nova-compute[71692]: INFO nova.compute.manager [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Took 7.97 seconds to spawn the instance on the hypervisor.
Apr 13 18:57:21 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:57:21 user nova-compute[71692]: INFO nova.compute.manager [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Took 9.16 seconds to build instance.
Apr 13 18:57:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a54e6c-8bdf-45e0-bb68-316df7a8dd71 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "570101b9-9c60-4c05-94ab-437a8a07d453" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.280s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:57:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 18:57:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] There are 0 instances to clean {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 18:57:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:57:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 18:57:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:57:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:27 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:57:27 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:57:27 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:57:27 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:57:28 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:57:28 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:57:29 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:57:30 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:57:30 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:57:30 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 18:57:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-b7d32500-da20-4a99-af04-5f422ac6ba0a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:57:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-b7d32500-da20-4a99-af04-5f422ac6ba0a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:57:30 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:57:30 user nova-compute[71692]: DEBUG nova.objects.instance [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lazy-loading 'info_cache' on Instance uuid b7d32500-da20-4a99-af04-5f422ac6ba0a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:57:30 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:30 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:31 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Updating instance_info_cache with network_info: [{"id": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "address": "fa:16:3e:33:03:fd", "network": {"id": "4f040dc3-577a-48e7-b46d-413f3b11a1fe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1853453695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577e81535534db29f5c81837949e958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1572a520-f7", "ovs_interfaceid": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:57:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-b7d32500-da20-4a99-af04-5f422ac6ba0a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:57:31 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:57:31 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:57:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:31 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:57:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:34 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:57:34 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:57:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=7649MB free_disk=26.433452606201172GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:57:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance b7d32500-da20-4a99-af04-5f422ac6ba0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance a15c1b5e-1769-490a-b81f-09333cd4a227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance f17525a6-e377-4b33-85cd-88a7aaf4569a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 106da0b9-c823-4f26-874c-53f8ad235e61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 570101b9-9c60-4c05-94ab-437a8a07d453 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing inventories for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating ProviderTree inventory for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating inventory in ProviderTree for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing aggregate associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, aggregates: None {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing trait associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.776s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "c655dda4-2db1-4f7c-8591-bb0512122583" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:48 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:57:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:57:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:57:49 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:57:49 user nova-compute[71692]: INFO nova.compute.claims [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Claim successful on node user
Apr 13 18:57:49 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:57:49 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:57:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:57:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:57:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:57:49 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:57:49 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:57:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:57:49 user nova-compute[71692]: INFO nova.virt.block_device [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Booting with volume 82b16cf4-0675-493a-ae28-0f0138b4a6a8 at /dev/vda
Apr 13 18:57:49 user nova-compute[71692]: DEBUG nova.policy [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f63a7e8a5a374e66b26f2309874c5adb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e7c45edf2a84f86b4c91c12edb8c66a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:57:49 user nova-compute[71692]: DEBUG os_brick.utils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:57:49 user nova-compute[71692]: INFO oslo.privsep.daemon [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpdl3tt7y9/privsep.sock']
Apr 13 18:57:49 user sudo[82228]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpdl3tt7y9/privsep.sock
Apr 13 18:57:49 user sudo[82228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 18:57:50 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Successfully created port: e45634b1-0f7f-4888-ae83-8567da56407d {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:57:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Successfully created port: 278cf193-9dcb-4703-b7d3-d3568a793952 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:57:51 user sudo[82228]: pam_unix(sudo:session): session closed for user root
Apr 13 18:57:51 user nova-compute[71692]: INFO oslo.privsep.daemon [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Spawned new privsep daemon via rootwrap
Apr 13 18:57:51 user nova-compute[71692]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 18:57:51 user nova-compute[71692]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 18:57:51 user nova-compute[71692]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 13 18:57:51 user nova-compute[71692]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82243
Apr 13 18:57:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a14d5b-5442-42ba-acc7-3a63dd6f3803]: (2,) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf86446-18bc-4673-bf96-c59801fee1d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:57:51 user nova-compute[71692]: WARNING os_brick.initiator.connectors.nvmeof [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 13 18:57:51 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Successfully created port: 0411f083-60b0-41d4-af75-a509ace59ad5 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7657a2-0059-4eef-802e-2e7f4c538330]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b2ea43-80d5-499e-824f-b118cb31fbb9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22494f5-774b-4f98-9fbd-5ff8167a68dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:57:51 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:57:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e1894b-2f87-4ac4-b4e0-471dcf90bf1a]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG os_brick.utils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] <== get_connector_properties: return (1975ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:57:51 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Updating existing volume attachment record: 82c735f5-2d39-4e2b-a03b-1e2f07f6c1c5 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:57:52 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Successfully created port: 8f025dce-fc38-4414-8e60-c924fd38d5dd {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:57:52 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Successfully created port: 50b51917-5a26-4a85-878a-7d21023a7fb1 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:57:53 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Successfully updated port: e45634b1-0f7f-4888-ae83-8567da56407d {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:57:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-de802251-5b1f-43a8-a24e-63db0c99d30e req-659a4570-5af4-42c5-84ea-d48c61a1eb08 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-changed-e45634b1-0f7f-4888-ae83-8567da56407d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-de802251-5b1f-43a8-a24e-63db0c99d30e req-659a4570-5af4-42c5-84ea-d48c61a1eb08 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Refreshing instance network info cache due to event network-changed-e45634b1-0f7f-4888-ae83-8567da56407d. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:57:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-de802251-5b1f-43a8-a24e-63db0c99d30e req-659a4570-5af4-42c5-84ea-d48c61a1eb08 service nova] Acquiring lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:57:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-de802251-5b1f-43a8-a24e-63db0c99d30e req-659a4570-5af4-42c5-84ea-d48c61a1eb08 service nova] Acquired lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:57:53 user nova-compute[71692]: DEBUG nova.network.neutron [req-de802251-5b1f-43a8-a24e-63db0c99d30e req-659a4570-5af4-42c5-84ea-d48c61a1eb08 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Refreshing network info cache for port e45634b1-0f7f-4888-ae83-8567da56407d {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:57:53 user nova-compute[71692]: DEBUG nova.network.neutron [req-de802251-5b1f-43a8-a24e-63db0c99d30e req-659a4570-5af4-42c5-84ea-d48c61a1eb08 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:57:53 user nova-compute[71692]: DEBUG nova.network.neutron [req-de802251-5b1f-43a8-a24e-63db0c99d30e req-659a4570-5af4-42c5-84ea-d48c61a1eb08 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:57:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-de802251-5b1f-43a8-a24e-63db0c99d30e req-659a4570-5af4-42c5-84ea-d48c61a1eb08 service nova] Releasing lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:57:54 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Successfully updated port: 7512b86a-c124-4ae8-907e-8490d9444e87 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:57:54 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Successfully updated port: 624b1877-60ef-44ae-b9fa-c07cacb7fb72 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:57:55 user nova-compute[71692]: DEBUG nova.compute.manager [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-changed-7512b86a-c124-4ae8-907e-8490d9444e87 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:55 user nova-compute[71692]: DEBUG nova.compute.manager [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Refreshing instance network info cache due to event network-changed-7512b86a-c124-4ae8-907e-8490d9444e87. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:57:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] Acquiring lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:57:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] Acquired lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:57:55 user nova-compute[71692]: DEBUG nova.network.neutron [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Refreshing network info cache for port 7512b86a-c124-4ae8-907e-8490d9444e87 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:57:55 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Successfully updated port: 278cf193-9dcb-4703-b7d3-d3568a793952 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:57:55 user nova-compute[71692]: DEBUG nova.network.neutron [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:57:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:57:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 18:57:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:57:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 18:57:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG nova.network.neutron [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] Releasing lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-changed-624b1877-60ef-44ae-b9fa-c07cacb7fb72 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Refreshing instance network info cache due to event network-changed-624b1877-60ef-44ae-b9fa-c07cacb7fb72. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] Acquiring lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] Acquired lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG nova.network.neutron [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Refreshing network info cache for port 624b1877-60ef-44ae-b9fa-c07cacb7fb72 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG nova.network.neutron [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:57:56 user nova-compute[71692]: INFO nova.virt.block_device [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Booting with volume 77537746-09dc-4379-b7d5-e17995736c65 at /dev/vdb
Apr 13 18:57:56 user nova-compute[71692]: DEBUG os_brick.utils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[19682795-6591-4641-a5f4-313ccce08c7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9af1c8-eb93-42b2-8b8c-4510b87ecc76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4801db-0c56-476b-9aa2-ea21277ff2d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaa8b50-9b19-4ae0-b61a-10be8d91cd6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG nova.network.neutron [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-163e77a7-aa02-4703-958b-11d87e08e421 req-8d936933-ee09-4a47-af8c-83484f9c2b8d service nova] Releasing lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:57:56 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:57:56 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b8b57e-6506-421c-b2bb-abfa50246647]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG os_brick.utils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Updating existing volume attachment record: 4d0cbdaf-1d46-43a8-83bf-5a3c6adc830d {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:57:56 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Successfully updated port: 0411f083-60b0-41d4-af75-a509ace59ad5 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:57:57 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Successfully updated port: 8f025dce-fc38-4414-8e60-c924fd38d5dd {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:57:57 user nova-compute[71692]: DEBUG nova.compute.manager [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-changed-278cf193-9dcb-4703-b7d3-d3568a793952 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:57 user nova-compute[71692]: DEBUG nova.compute.manager [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Refreshing instance network info cache due to event network-changed-278cf193-9dcb-4703-b7d3-d3568a793952. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:57:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] Acquiring lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:57:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] Acquired lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:57:57 user nova-compute[71692]: DEBUG nova.network.neutron [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Refreshing network info cache for port 278cf193-9dcb-4703-b7d3-d3568a793952 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:57:57 user nova-compute[71692]: DEBUG nova.network.neutron [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:57:57 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Successfully updated port: 50b51917-5a26-4a85-878a-7d21023a7fb1 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:57:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:57:58 user nova-compute[71692]: DEBUG nova.network.neutron [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:57:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] Releasing lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:57:58 user nova-compute[71692]: DEBUG nova.compute.manager [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-changed-0411f083-60b0-41d4-af75-a509ace59ad5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:58 user nova-compute[71692]: DEBUG nova.compute.manager [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Refreshing instance network info cache due to event network-changed-0411f083-60b0-41d4-af75-a509ace59ad5. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:57:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] Acquiring lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:57:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] Acquired lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:57:58 user nova-compute[71692]: DEBUG nova.network.neutron [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Refreshing network info cache for port 0411f083-60b0-41d4-af75-a509ace59ad5 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:57:58 user nova-compute[71692]: DEBUG nova.network.neutron [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:57:58 user nova-compute[71692]: DEBUG nova.network.neutron [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:57:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] Releasing lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:57:58 user nova-compute[71692]: DEBUG nova.compute.manager [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-changed-8f025dce-fc38-4414-8e60-c924fd38d5dd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:58 user nova-compute[71692]: DEBUG nova.compute.manager [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Refreshing instance network info cache due to event network-changed-8f025dce-fc38-4414-8e60-c924fd38d5dd. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:57:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] Acquiring lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:57:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] Acquired lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:57:58 user nova-compute[71692]: DEBUG nova.network.neutron [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Refreshing network info cache for port 8f025dce-fc38-4414-8e60-c924fd38d5dd {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:57:58 user nova-compute[71692]: DEBUG nova.network.neutron [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:57:59 user nova-compute[71692]: DEBUG nova.network.neutron [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:57:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-26ca3b49-b045-4660-99df-d3f2f814d28c req-42baed8a-3258-4d01-9d9d-edafb3714844 service nova] Releasing lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:57:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquired lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:57:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:57:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:57:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-bd4f046e-a35c-48d9-b29b-efcbb822dece req-150a5142-564d-456a-80a3-6927894ddbd1 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-changed-50b51917-5a26-4a85-878a-7d21023a7fb1 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:57:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-bd4f046e-a35c-48d9-b29b-efcbb822dece req-150a5142-564d-456a-80a3-6927894ddbd1 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Refreshing instance network info cache due to event network-changed-50b51917-5a26-4a85-878a-7d21023a7fb1. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:57:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-bd4f046e-a35c-48d9-b29b-efcbb822dece req-150a5142-564d-456a-80a3-6927894ddbd1 service nova] Acquiring lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:58:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:00 user nova-compute[71692]: INFO nova.virt.block_device [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Booting with volume 75a05b92-4932-42a8-bd0b-ba98b157827a at /dev/vdc
Apr 13 18:58:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:00 user nova-compute[71692]: DEBUG os_brick.utils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:58:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:00 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7677a0-77d2-4f9e-bf3d-db6b242a4465]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4471f4c4-d03c-4a98-b90e-d5a4a7c8ec0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3745b24e-58e9-4da1-a3ce-6d521010e4af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8429438-b9ef-431e-9271-2c86a6e73082]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:58:01 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:58:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f494dc-2234-42a6-bb01-b3a56a2b8e4e]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG os_brick.utils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Updating existing volume attachment record: 97ba6347-2d5c-4ce4-b1e8-c9a9bbfcf60f {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Updating instance_info_cache with network_info: [{"id": "e45634b1-0f7f-4888-ae83-8567da56407d", "address": "fa:16:3e:b4:c4:a8", "network": {"id": "70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-97878308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45634b1-0f", "ovs_interfaceid": "e45634b1-0f7f-4888-ae83-8567da56407d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7512b86a-c124-4ae8-907e-8490d9444e87", "address": "fa:16:3e:19:a9:5d", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7512b86a-c1", "ovs_interfaceid": "7512b86a-c124-4ae8-907e-8490d9444e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "address": "fa:16:3e:38:22:da", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624b1877-60", "ovs_interfaceid": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "278cf193-9dcb-4703-b7d3-d3568a793952", "address": "fa:16:3e:38:e8:29", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278cf193-9d", "ovs_interfaceid": "278cf193-9dcb-4703-b7d3-d3568a793952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0411f083-60b0-41d4-af75-a509ace59ad5", "address": "fa:16:3e:62:0c:34", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0411f083-60", "ovs_interfaceid": "0411f083-60b0-41d4-af75-a509ace59ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "address": "fa:16:3e:f8:52:0d", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f025dce-fc", "ovs_interfaceid": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50b51917-5a26-4a85-878a-7d21023a7fb1", "address": "fa:16:3e:5e:58:be", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b51917-5a", "ovs_interfaceid": "50b51917-5a26-4a85-878a-7d21023a7fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Releasing lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Instance network_info: |[{"id": "e45634b1-0f7f-4888-ae83-8567da56407d", "address": "fa:16:3e:b4:c4:a8", "network": {"id": "70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-97878308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45634b1-0f", "ovs_interfaceid": "e45634b1-0f7f-4888-ae83-8567da56407d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7512b86a-c124-4ae8-907e-8490d9444e87", "address": "fa:16:3e:19:a9:5d", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7512b86a-c1", "ovs_interfaceid": "7512b86a-c124-4ae8-907e-8490d9444e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "address": "fa:16:3e:38:22:da", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624b1877-60", "ovs_interfaceid": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "278cf193-9dcb-4703-b7d3-d3568a793952", "address": "fa:16:3e:38:e8:29", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278cf193-9d", "ovs_interfaceid": "278cf193-9dcb-4703-b7d3-d3568a793952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0411f083-60b0-41d4-af75-a509ace59ad5", "address": "fa:16:3e:62:0c:34", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0411f083-60", "ovs_interfaceid": "0411f083-60b0-41d4-af75-a509ace59ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "address": "fa:16:3e:f8:52:0d", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f025dce-fc", "ovs_interfaceid": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50b51917-5a26-4a85-878a-7d21023a7fb1", "address": "fa:16:3e:5e:58:be", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b51917-5a", "ovs_interfaceid": "50b51917-5a26-4a85-878a-7d21023a7fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-bd4f046e-a35c-48d9-b29b-efcbb822dece req-150a5142-564d-456a-80a3-6927894ddbd1 service nova] Acquired lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG nova.network.neutron [req-bd4f046e-a35c-48d9-b29b-efcbb822dece req-150a5142-564d-456a-80a3-6927894ddbd1 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Refreshing network info cache for port 50b51917-5a26-4a85-878a-7d21023a7fb1 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG nova.network.neutron [req-bd4f046e-a35c-48d9-b29b-efcbb822dece req-150a5142-564d-456a-80a3-6927894ddbd1 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Updated VIF entry in instance network info cache for port 50b51917-5a26-4a85-878a-7d21023a7fb1. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG nova.network.neutron [req-bd4f046e-a35c-48d9-b29b-efcbb822dece req-150a5142-564d-456a-80a3-6927894ddbd1 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Updating instance_info_cache with network_info: [{"id": "e45634b1-0f7f-4888-ae83-8567da56407d", "address": "fa:16:3e:b4:c4:a8", "network": {"id": "70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-97878308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45634b1-0f", "ovs_interfaceid": "e45634b1-0f7f-4888-ae83-8567da56407d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7512b86a-c124-4ae8-907e-8490d9444e87", "address": "fa:16:3e:19:a9:5d", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7512b86a-c1", "ovs_interfaceid": "7512b86a-c124-4ae8-907e-8490d9444e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "address": "fa:16:3e:38:22:da", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624b1877-60", "ovs_interfaceid": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "278cf193-9dcb-4703-b7d3-d3568a793952", "address": "fa:16:3e:38:e8:29", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278cf193-9d", "ovs_interfaceid": "278cf193-9dcb-4703-b7d3-d3568a793952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0411f083-60b0-41d4-af75-a509ace59ad5", "address": "fa:16:3e:62:0c:34", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0411f083-60", "ovs_interfaceid": "0411f083-60b0-41d4-af75-a509ace59ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "address": "fa:16:3e:f8:52:0d", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f025dce-fc", "ovs_interfaceid": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50b51917-5a26-4a85-878a-7d21023a7fb1", "address": "fa:16:3e:5e:58:be", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b51917-5a", "ovs_interfaceid": "50b51917-5a26-4a85-878a-7d21023a7fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:58:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-bd4f046e-a35c-48d9-b29b-efcbb822dece req-150a5142-564d-456a-80a3-6927894ddbd1 service nova] Releasing lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:58:05 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Creating image(s)
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Did not create local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Ensure instance console log exists: /opt/stack/data/nova/instances/c655dda4-2db1-4f7c-8591-bb0512122583/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Start _get_guest_xml network_info=[{"id": "e45634b1-0f7f-4888-ae83-8567da56407d", "address": "fa:16:3e:b4:c4:a8", "network": {"id": "70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-97878308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45634b1-0f", "ovs_interfaceid": "e45634b1-0f7f-4888-ae83-8567da56407d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7512b86a-c124-4ae8-907e-8490d9444e87", "address": "fa:16:3e:19:a9:5d", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7512b86a-c1", "ovs_interfaceid": "7512b86a-c124-4ae8-907e-8490d9444e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "address": "fa:16:3e:38:22:da", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624b1877-60", "ovs_interfaceid": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "278cf193-9dcb-4703-b7d3-d3568a793952", "address": "fa:16:3e:38:e8:29", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278cf193-9d", "ovs_interfaceid": "278cf193-9dcb-4703-b7d3-d3568a793952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0411f083-60b0-41d4-af75-a509ace59ad5", "address": "fa:16:3e:62:0c:34", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0411f083-60", "ovs_interfaceid": "0411f083-60b0-41d4-af75-a509ace59ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "address": "fa:16:3e:f8:52:0d", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f025dce-fc", "ovs_interfaceid": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50b51917-5a26-4a85-878a-7d21023a7fb1", "address": "fa:16:3e:5e:58:be", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b51917-5a", "ovs_interfaceid": "50b51917-5a26-4a85-878a-7d21023a7fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '82c735f5-2d39-4e2b-a03b-1e2f07f6c1c5', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCPAznqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c655dda4-2db1-4f7c-8591-bb0512122583', 'attached_at': '', 'detached_at': '', 'volume_id': '82b16cf4-0675-493a-ae28-0f0138b4a6a8', 'serial': '82b16cf4-0675-493a-ae28-0f0138b4a6a8'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 1, 'attachment_id': '4d0cbdaf-1d46-43a8-83bf-5a3c6adc830d', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqMZmkJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c655dda4-2db1-4f7c-8591-bb0512122583', 'attached_at': '', 'detached_at': '', 'volume_id': '77537746-09dc-4379-b7d5-e17995736c65', 'serial': '77537746-09dc-4379-b7d5-e17995736c65'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 2, 'attachment_id': '97ba6347-2d5c-4ce4-b1e8-c9a9bbfcf60f', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADdhnvWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c655dda4-2db1-4f7c-8591-bb0512122583', 'attached_at': '', 'detached_at': '', 'volume_id': '75a05b92-4932-42a8-bd0b-ba98b157827a', 'serial': '75a05b92-4932-42a8-bd0b-ba98b157827a'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:58:05 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:58:05 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connector [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Factory for ISCSI on None {{(pid=71692) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCPAznqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:58:05 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:58:05 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:58:05 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260" returned: 21 in 0.039s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a92f92-54a1-4dc3-ad7a-24ed0af79824]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:58:05 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e1c3b5-b373-4ac7-9c0a-a5f20c354c56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8] added
Apr 13 18:58:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50d7b06-9481-4095-93f4-1c6d90c2308f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6588cbe8-7ba3-42d8-a01b-d9afa6723927]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JCPAznqo {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JCPAznqo" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f683b6ea-4f59-4421-8d9e-d6e122ba4591]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JCPAznqo'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd342ca-0aa5-442e-b72c-5a357804eb99]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9325d37a-fc20-4e9d-b566-910dc24361fb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 18:58:05 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 18:58:05 user nova-compute[71692]:  {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:58:05 user nova-compute[71692]: WARNING os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 18:58:05 user nova-compute[71692]: 
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6af408f-5243-40c9-b6e3-ebc16d2dfea8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8, portal: 172.16.0.220,3260]
Apr 13 18:58:05 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8, portal: 172.16.0.220,3260] successful.
Apr 13 18:58:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[278cb681-5755-4887-b945-a3ae63de6583]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5b3d90-58e2-4b1c-8f6b-fea3eebb7282]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d48ad5-dc2e-467e-9a60-6d5cae256c3a]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:58:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:06 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:58:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCPAznqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:58:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:58:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23730326431306163', 'path': '/dev/sdb'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:58:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730326431306163', 'path': '/dev/sdb'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:58:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:58:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqMZmkJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:58:06 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:58:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:58:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:58:06 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:58:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:58:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:58:06 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:58:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e3a8b1-de98-4ae8-b9ea-17814b8cb47a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:58:06 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7684a1-cd74-4c74-904f-ed40fd549aba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65] added
Apr 13 18:58:07 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a17e4f-c2a9-4f91-93c8-5c4be639a8d3]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b15911-ba57-4bf1-b8a3-7d86f00ab451]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqMZmkJB {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqMZmkJB" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57ea6b1-aac0-4b31-835d-200d52fb96f1]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DqMZmkJB'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc28752-b0a2-41af-b199-5bbad25f43cc]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fa9aa6-9f2c-4a0e-b218-0dfe2b409888]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:07 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:07 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1344b5e0-8983-4c46-b98d-7a946d547513]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65, portal: 172.16.0.220,3260]
Apr 13 18:58:07 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65, portal: 172.16.0.220,3260] successful.
Apr 13 18:58:07 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4898ac3e-005d-42ba-bc2a-8530877f15fc]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f208bf6a-08ea-4ca9-8511-12c88520b33b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:07 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:58:07 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:07 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:58:07 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd73cf7-6c83-4399-95b5-29241adc1eda]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:07 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqMZmkJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26661313333363365', 'path': '/dev/sdc'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661313333363365', 'path': '/dev/sdc'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADdhnvWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:58:08 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:58:08 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:58:08 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2262d20-733d-489c-b84c-7ce67c0b1695]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:58:08 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fe887c-5cab-4ede-a5b8-a9675bdf8ce8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a] added
Apr 13 18:58:08 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ebaf66-3df7-444c-b429-d57f9c682f54]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fd78dc-c3c7-4126-8ed3-e4c4ac88fe44]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ADdhnvWL {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ADdhnvWL" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b971c4ee-aad4-489f-bdf3-a9d042aeb3fd]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ADdhnvWL'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0add24fa-ff7d-4741-9c20-18b4a8ee3a97]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b63460a-a6f1-4563-9240-38d0f35d9849]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:08 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:58:08 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:08 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:58:08 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be19ea6-cffb-4b69-b8e0-d1bb97930685]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a, portal: 172.16.0.220,3260]
Apr 13 18:58:08 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a, portal: 172.16.0.220,3260] successful.
Apr 13 18:58:08 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abbe62f-3a66-443b-b76f-cb51314f4c14]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c0c6f6-cddc-43bb-adb2-9466ef37ee90]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:08 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:58:08 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:58:08 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:08 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:58:08 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:58:08 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[81672e2e-00f6-4711-b0eb-758ead1ce827]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:58:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADdhnvWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23535313863326164', 'path': '/dev/sdd'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535313863326164', 'path': '/dev/sdd'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e45634b1-0f7f-4888-ae83-8567da56407d", "address": "fa:16:3e:b4:c4:a8", "network": {"id": "70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-97878308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45634b1-0f", "ovs_interfaceid": "e45634b1-0f7f-4888-ae83-8567da56407d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "e45634b1-0f7f-4888-ae83-8567da56407d", "address": "fa:16:3e:b4:c4:a8", "network": {"id": "70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-97878308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45634b1-0f", "ovs_interfaceid": "e45634b1-0f7f-4888-ae83-8567da56407d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c4:a8,bridge_name='br-int',has_traffic_filtering=True,id=e45634b1-0f7f-4888-ae83-8567da56407d,network=Network(70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape45634b1-0f') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7512b86a-c124-4ae8-907e-8490d9444e87", "address": "fa:16:3e:19:a9:5d", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7512b86a-c1", "ovs_interfaceid": "7512b86a-c124-4ae8-907e-8490d9444e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "7512b86a-c124-4ae8-907e-8490d9444e87", "address": "fa:16:3e:19:a9:5d", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7512b86a-c1", "ovs_interfaceid": "7512b86a-c124-4ae8-907e-8490d9444e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:a9:5d,bridge_name='br-int',has_traffic_filtering=True,id=7512b86a-c124-4ae8-907e-8490d9444e87,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7512b86a-c1') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "address": "fa:16:3e:38:22:da", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624b1877-60", "ovs_interfaceid": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "address": "fa:16:3e:38:22:da", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624b1877-60", "ovs_interfaceid": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:22:da,bridge_name='br-int',has_traffic_filtering=True,id=624b1877-60ef-44ae-b9fa-c07cacb7fb72,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap624b1877-60') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "278cf193-9dcb-4703-b7d3-d3568a793952", "address": "fa:16:3e:38:e8:29", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278cf193-9d", "ovs_interfaceid": "278cf193-9dcb-4703-b7d3-d3568a793952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "278cf193-9dcb-4703-b7d3-d3568a793952", "address": "fa:16:3e:38:e8:29", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278cf193-9d", "ovs_interfaceid": "278cf193-9dcb-4703-b7d3-d3568a793952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:e8:29,bridge_name='br-int',has_traffic_filtering=True,id=278cf193-9dcb-4703-b7d3-d3568a793952,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278cf193-9d') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0411f083-60b0-41d4-af75-a509ace59ad5", "address": "fa:16:3e:62:0c:34", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0411f083-60", "ovs_interfaceid": "0411f083-60b0-41d4-af75-a509ace59ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "0411f083-60b0-41d4-af75-a509ace59ad5", "address": "fa:16:3e:62:0c:34", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0411f083-60", "ovs_interfaceid": "0411f083-60b0-41d4-af75-a509ace59ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:0c:34,bridge_name='br-int',has_traffic_filtering=True,id=0411f083-60b0-41d4-af75-a509ace59ad5,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0411f083-60') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "address": "fa:16:3e:f8:52:0d", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f025dce-fc", "ovs_interfaceid": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "address": "fa:16:3e:f8:52:0d", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f025dce-fc", "ovs_interfaceid": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:52:0d,bridge_name='br-int',has_traffic_filtering=True,id=8f025dce-fc38-4414-8e60-c924fd38d5dd,network=Network(5e734b04-2d73-42af-b120-2063ab3d7c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f025dce-fc') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50b51917-5a26-4a85-878a-7d21023a7fb1", "address": "fa:16:3e:5e:58:be", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b51917-5a", "ovs_interfaceid": "50b51917-5a26-4a85-878a-7d21023a7fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "50b51917-5a26-4a85-878a-7d21023a7fb1", "address": "fa:16:3e:5e:58:be", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b51917-5a", "ovs_interfaceid": "50b51917-5a26-4a85-878a-7d21023a7fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:58:be,bridge_name='br-int',has_traffic_filtering=True,id=50b51917-5a26-4a85-878a-7d21023a7fb1,network=Network(5e734b04-2d73-42af-b120-2063ab3d7c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b51917-5a') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.objects.instance [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lazy-loading 'pci_devices' on Instance uuid c655dda4-2db1-4f7c-8591-bb0512122583 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:58:09 user nova-compute[71692]:   <uuid>c655dda4-2db1-4f7c-8591-bb0512122583</uuid>
Apr 13 18:58:09 user nova-compute[71692]:   <name>instance-00000009</name>
Apr 13 18:58:09 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 18:58:09 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 18:58:09 user nova-compute[71692]:   <metadata>
Apr 13 18:58:09 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:58:09 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 18:58:09 user nova-compute[71692]:       <nova:name>tempest-device-tagging-server-1372126936</nova:name>
Apr 13 18:58:09 user nova-compute[71692]:       <nova:creationTime>2023-04-13 18:58:05</nova:creationTime>
Apr 13 18:58:09 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 18:58:09 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 18:58:09 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 18:58:09 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 18:58:09 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:58:09 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:58:09 user nova-compute[71692]:       </nova:flavor>
Apr 13 18:58:09 user nova-compute[71692]:       <nova:owner>
Apr 13 18:58:09 user nova-compute[71692]:         <nova:user uuid="f63a7e8a5a374e66b26f2309874c5adb">tempest-TaggedBootDevicesTest_v242-573903665-project-member</nova:user>
Apr 13 18:58:09 user nova-compute[71692]:         <nova:project uuid="0e7c45edf2a84f86b4c91c12edb8c66a">tempest-TaggedBootDevicesTest_v242-573903665</nova:project>
Apr 13 18:58:09 user nova-compute[71692]:       </nova:owner>
Apr 13 18:58:09 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 18:58:09 user nova-compute[71692]:       <nova:ports>
Apr 13 18:58:09 user nova-compute[71692]:         <nova:port uuid="e45634b1-0f7f-4888-ae83-8567da56407d">
Apr 13 18:58:09 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 18:58:09 user nova-compute[71692]:         </nova:port>
Apr 13 18:58:09 user nova-compute[71692]:         <nova:port uuid="7512b86a-c124-4ae8-907e-8490d9444e87">
Apr 13 18:58:09 user nova-compute[71692]:           <nova:ip type="fixed" address="10.1.1.11" ipVersion="4"/>
Apr 13 18:58:09 user nova-compute[71692]:         </nova:port>
Apr 13 18:58:09 user nova-compute[71692]:         <nova:port uuid="624b1877-60ef-44ae-b9fa-c07cacb7fb72">
Apr 13 18:58:09 user nova-compute[71692]:           <nova:ip type="fixed" address="10.1.1.61" ipVersion="4"/>
Apr 13 18:58:09 user nova-compute[71692]:         </nova:port>
Apr 13 18:58:09 user nova-compute[71692]:         <nova:port uuid="278cf193-9dcb-4703-b7d3-d3568a793952">
Apr 13 18:58:09 user nova-compute[71692]:           <nova:ip type="fixed" address="10.1.1.148" ipVersion="4"/>
Apr 13 18:58:09 user nova-compute[71692]:         </nova:port>
Apr 13 18:58:09 user nova-compute[71692]:         <nova:port uuid="0411f083-60b0-41d4-af75-a509ace59ad5">
Apr 13 18:58:09 user nova-compute[71692]:           <nova:ip type="fixed" address="10.1.1.30" ipVersion="4"/>
Apr 13 18:58:09 user nova-compute[71692]:         </nova:port>
Apr 13 18:58:09 user nova-compute[71692]:         <nova:port uuid="8f025dce-fc38-4414-8e60-c924fd38d5dd">
Apr 13 18:58:09 user nova-compute[71692]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 13 18:58:09 user nova-compute[71692]:         </nova:port>
Apr 13 18:58:09 user nova-compute[71692]:         <nova:port uuid="50b51917-5a26-4a85-878a-7d21023a7fb1">
Apr 13 18:58:09 user nova-compute[71692]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 13 18:58:09 user nova-compute[71692]:         </nova:port>
Apr 13 18:58:09 user nova-compute[71692]:       </nova:ports>
Apr 13 18:58:09 user nova-compute[71692]:     </nova:instance>
Apr 13 18:58:09 user nova-compute[71692]:   </metadata>
Apr 13 18:58:09 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 18:58:09 user nova-compute[71692]:     <system>
Apr 13 18:58:09 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:58:09 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:58:09 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 18:58:09 user nova-compute[71692]:       <entry name="serial">c655dda4-2db1-4f7c-8591-bb0512122583</entry>
Apr 13 18:58:09 user nova-compute[71692]:       <entry name="uuid">c655dda4-2db1-4f7c-8591-bb0512122583</entry>
Apr 13 18:58:09 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:58:09 user nova-compute[71692]:     </system>
Apr 13 18:58:09 user nova-compute[71692]:   </sysinfo>
Apr 13 18:58:09 user nova-compute[71692]:   <os>
Apr 13 18:58:09 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:58:09 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 18:58:09 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 18:58:09 user nova-compute[71692]:   </os>
Apr 13 18:58:09 user nova-compute[71692]:   <features>
Apr 13 18:58:09 user nova-compute[71692]:     <acpi/>
Apr 13 18:58:09 user nova-compute[71692]:     <apic/>
Apr 13 18:58:09 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 18:58:09 user nova-compute[71692]:   </features>
Apr 13 18:58:09 user nova-compute[71692]:   <clock offset="utc">
Apr 13 18:58:09 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:58:09 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:58:09 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 18:58:09 user nova-compute[71692]:   </clock>
Apr 13 18:58:09 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 18:58:09 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 18:58:09 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:58:09 user nova-compute[71692]:   </cpu>
Apr 13 18:58:09 user nova-compute[71692]:   <devices>
Apr 13 18:58:09 user nova-compute[71692]:     <disk type="file" device="cdrom">
Apr 13 18:58:09 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 18:58:09 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/c655dda4-2db1-4f7c-8591-bb0512122583/disk.config"/>
Apr 13 18:58:09 user nova-compute[71692]:       <target dev="hda" bus="ide"/>
Apr 13 18:58:09 user nova-compute[71692]:     </disk>
Apr 13 18:58:09 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 18:58:09 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:58:09 user nova-compute[71692]:       <source dev="/dev/sdb"/>
Apr 13 18:58:09 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 18:58:09 user nova-compute[71692]:       <serial>82b16cf4-0675-493a-ae28-0f0138b4a6a8</serial>
Apr 13 18:58:09 user nova-compute[71692]:     </disk>
Apr 13 18:58:09 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 18:58:09 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:58:09 user nova-compute[71692]:       <source dev="/dev/sdc"/>
Apr 13 18:58:09 user nova-compute[71692]:       <target dev="vdb" bus="virtio"/>
Apr 13 18:58:09 user nova-compute[71692]:       <serial>77537746-09dc-4379-b7d5-e17995736c65</serial>
Apr 13 18:58:09 user nova-compute[71692]:     </disk>
Apr 13 18:58:09 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 18:58:09 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:58:09 user nova-compute[71692]:       <source dev="/dev/sdd"/>
Apr 13 18:58:09 user nova-compute[71692]:       <target dev="vdc" bus="virtio"/>
Apr 13 18:58:09 user nova-compute[71692]:       <serial>75a05b92-4932-42a8-bd0b-ba98b157827a</serial>
Apr 13 18:58:09 user nova-compute[71692]:     </disk>
Apr 13 18:58:09 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 18:58:09 user nova-compute[71692]:       <mac address="fa:16:3e:b4:c4:a8"/>
Apr 13 18:58:09 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:58:09 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 18:58:09 user nova-compute[71692]:       <target dev="tape45634b1-0f"/>
Apr 13 18:58:09 user nova-compute[71692]:     </interface>
Apr 13 18:58:09 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 18:58:09 user nova-compute[71692]:       <mac address="fa:16:3e:19:a9:5d"/>
Apr 13 18:58:09 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:58:09 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 18:58:09 user nova-compute[71692]:       <target dev="tap7512b86a-c1"/>
Apr 13 18:58:09 user nova-compute[71692]:     </interface>
Apr 13 18:58:09 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 18:58:09 user nova-compute[71692]:       <mac address="fa:16:3e:38:22:da"/>
Apr 13 18:58:09 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:58:09 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 18:58:09 user nova-compute[71692]:       <target dev="tap624b1877-60"/>
Apr 13 18:58:09 user nova-compute[71692]:     </interface>
Apr 13 18:58:09 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 18:58:09 user nova-compute[71692]:       <mac address="fa:16:3e:38:e8:29"/>
Apr 13 18:58:09 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:58:09 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 18:58:09 user nova-compute[71692]:       <target dev="tap278cf193-9d"/>
Apr 13 18:58:09 user nova-compute[71692]:     </interface>
Apr 13 18:58:09 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 18:58:09 user nova-compute[71692]:       <mac address="fa:16:3e:62:0c:34"/>
Apr 13 18:58:09 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:58:09 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 18:58:09 user nova-compute[71692]:       <target dev="tap0411f083-60"/>
Apr 13 18:58:09 user nova-compute[71692]:     </interface>
Apr 13 18:58:09 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 18:58:09 user nova-compute[71692]:       <mac address="fa:16:3e:f8:52:0d"/>
Apr 13 18:58:09 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:58:09 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 18:58:09 user nova-compute[71692]:       <target dev="tap8f025dce-fc"/>
Apr 13 18:58:09 user nova-compute[71692]:     </interface>
Apr 13 18:58:09 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 18:58:09 user nova-compute[71692]:       <mac address="fa:16:3e:5e:58:be"/>
Apr 13 18:58:09 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:58:09 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 18:58:09 user nova-compute[71692]:       <target dev="tap50b51917-5a"/>
Apr 13 18:58:09 user nova-compute[71692]:     </interface>
Apr 13 18:58:09 user nova-compute[71692]:     <serial type="pty">
Apr 13 18:58:09 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/c655dda4-2db1-4f7c-8591-bb0512122583/console.log" append="off"/>
Apr 13 18:58:09 user nova-compute[71692]:     </serial>
Apr 13 18:58:09 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:58:09 user nova-compute[71692]:     <video>
Apr 13 18:58:09 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:58:09 user nova-compute[71692]:     </video>
Apr 13 18:58:09 user nova-compute[71692]:     <rng model="virtio">
Apr 13 18:58:09 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:58:09 user nova-compute[71692]:     </rng>
Apr 13 18:58:09 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:58:09 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 18:58:09 user nova-compute[71692]:       <stats period="10"/>
Apr 13 18:58:09 user nova-compute[71692]:     </memballoon>
Apr 13 18:58:09 user nova-compute[71692]:   </devices>
Apr 13 18:58:09 user nova-compute[71692]: </domain>
Apr 13 18:58:09 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e45634b1-0f7f-4888-ae83-8567da56407d", "address": "fa:16:3e:b4:c4:a8", "network": {"id": "70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-97878308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45634b1-0f", "ovs_interfaceid": "e45634b1-0f7f-4888-ae83-8567da56407d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "e45634b1-0f7f-4888-ae83-8567da56407d", "address": "fa:16:3e:b4:c4:a8", "network": {"id": "70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-97878308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45634b1-0f", "ovs_interfaceid": "e45634b1-0f7f-4888-ae83-8567da56407d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c4:a8,bridge_name='br-int',has_traffic_filtering=True,id=e45634b1-0f7f-4888-ae83-8567da56407d,network=Network(70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape45634b1-0f') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG os_vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c4:a8,bridge_name='br-int',has_traffic_filtering=True,id=e45634b1-0f7f-4888-ae83-8567da56407d,network=Network(70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape45634b1-0f') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape45634b1-0f, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape45634b1-0f, col_values=(('external_ids', {'iface-id': 'e45634b1-0f7f-4888-ae83-8567da56407d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:c4:a8', 'vm-uuid': 'c655dda4-2db1-4f7c-8591-bb0512122583'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: INFO os_vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:c4:a8,bridge_name='br-int',has_traffic_filtering=True,id=e45634b1-0f7f-4888-ae83-8567da56407d,network=Network(70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape45634b1-0f')
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7512b86a-c124-4ae8-907e-8490d9444e87", "address": "fa:16:3e:19:a9:5d", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7512b86a-c1", "ovs_interfaceid": "7512b86a-c124-4ae8-907e-8490d9444e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "7512b86a-c124-4ae8-907e-8490d9444e87", "address": "fa:16:3e:19:a9:5d", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7512b86a-c1", "ovs_interfaceid": "7512b86a-c124-4ae8-907e-8490d9444e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:a9:5d,bridge_name='br-int',has_traffic_filtering=True,id=7512b86a-c124-4ae8-907e-8490d9444e87,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7512b86a-c1') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG os_vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:a9:5d,bridge_name='br-int',has_traffic_filtering=True,id=7512b86a-c124-4ae8-907e-8490d9444e87,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7512b86a-c1') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7512b86a-c1, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7512b86a-c1, col_values=(('external_ids', {'iface-id': '7512b86a-c124-4ae8-907e-8490d9444e87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:a9:5d', 'vm-uuid': 'c655dda4-2db1-4f7c-8591-bb0512122583'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: INFO os_vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:a9:5d,bridge_name='br-int',has_traffic_filtering=True,id=7512b86a-c124-4ae8-907e-8490d9444e87,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7512b86a-c1')
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "address": "fa:16:3e:38:22:da", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624b1877-60", "ovs_interfaceid": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "address": "fa:16:3e:38:22:da", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624b1877-60", "ovs_interfaceid": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:22:da,bridge_name='br-int',has_traffic_filtering=True,id=624b1877-60ef-44ae-b9fa-c07cacb7fb72,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap624b1877-60') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG os_vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:22:da,bridge_name='br-int',has_traffic_filtering=True,id=624b1877-60ef-44ae-b9fa-c07cacb7fb72,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap624b1877-60') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap624b1877-60, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap624b1877-60, col_values=(('external_ids', {'iface-id': '624b1877-60ef-44ae-b9fa-c07cacb7fb72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:22:da', 'vm-uuid': 'c655dda4-2db1-4f7c-8591-bb0512122583'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: INFO os_vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:22:da,bridge_name='br-int',has_traffic_filtering=True,id=624b1877-60ef-44ae-b9fa-c07cacb7fb72,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap624b1877-60')
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "278cf193-9dcb-4703-b7d3-d3568a793952", "address": "fa:16:3e:38:e8:29", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278cf193-9d", "ovs_interfaceid": "278cf193-9dcb-4703-b7d3-d3568a793952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "278cf193-9dcb-4703-b7d3-d3568a793952", "address": "fa:16:3e:38:e8:29", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278cf193-9d", "ovs_interfaceid": "278cf193-9dcb-4703-b7d3-d3568a793952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:e8:29,bridge_name='br-int',has_traffic_filtering=True,id=278cf193-9dcb-4703-b7d3-d3568a793952,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278cf193-9d') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG os_vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:e8:29,bridge_name='br-int',has_traffic_filtering=True,id=278cf193-9dcb-4703-b7d3-d3568a793952,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278cf193-9d') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap278cf193-9d, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap278cf193-9d, col_values=(('external_ids', {'iface-id': '278cf193-9dcb-4703-b7d3-d3568a793952', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:e8:29', 'vm-uuid': 'c655dda4-2db1-4f7c-8591-bb0512122583'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: INFO os_vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:e8:29,bridge_name='br-int',has_traffic_filtering=True,id=278cf193-9dcb-4703-b7d3-d3568a793952,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278cf193-9d')
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0411f083-60b0-41d4-af75-a509ace59ad5", "address": "fa:16:3e:62:0c:34", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0411f083-60", "ovs_interfaceid": "0411f083-60b0-41d4-af75-a509ace59ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "0411f083-60b0-41d4-af75-a509ace59ad5", "address": "fa:16:3e:62:0c:34", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0411f083-60", "ovs_interfaceid": "0411f083-60b0-41d4-af75-a509ace59ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:0c:34,bridge_name='br-int',has_traffic_filtering=True,id=0411f083-60b0-41d4-af75-a509ace59ad5,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0411f083-60') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG os_vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:0c:34,bridge_name='br-int',has_traffic_filtering=True,id=0411f083-60b0-41d4-af75-a509ace59ad5,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0411f083-60') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0411f083-60, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0411f083-60, col_values=(('external_ids', {'iface-id': '0411f083-60b0-41d4-af75-a509ace59ad5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:0c:34', 'vm-uuid': 'c655dda4-2db1-4f7c-8591-bb0512122583'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: INFO os_vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:0c:34,bridge_name='br-int',has_traffic_filtering=True,id=0411f083-60b0-41d4-af75-a509ace59ad5,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0411f083-60')
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "address": "fa:16:3e:f8:52:0d", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f025dce-fc", "ovs_interfaceid": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "address": "fa:16:3e:f8:52:0d", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f025dce-fc", "ovs_interfaceid": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:52:0d,bridge_name='br-int',has_traffic_filtering=True,id=8f025dce-fc38-4414-8e60-c924fd38d5dd,network=Network(5e734b04-2d73-42af-b120-2063ab3d7c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f025dce-fc') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG os_vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:52:0d,bridge_name='br-int',has_traffic_filtering=True,id=8f025dce-fc38-4414-8e60-c924fd38d5dd,network=Network(5e734b04-2d73-42af-b120-2063ab3d7c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f025dce-fc') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f025dce-fc, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f025dce-fc, col_values=(('external_ids', {'iface-id': '8f025dce-fc38-4414-8e60-c924fd38d5dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:52:0d', 'vm-uuid': 'c655dda4-2db1-4f7c-8591-bb0512122583'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: INFO os_vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:52:0d,bridge_name='br-int',has_traffic_filtering=True,id=8f025dce-fc38-4414-8e60-c924fd38d5dd,network=Network(5e734b04-2d73-42af-b120-2063ab3d7c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f025dce-fc')
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50b51917-5a26-4a85-878a-7d21023a7fb1", "address": "fa:16:3e:5e:58:be", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b51917-5a", "ovs_interfaceid": "50b51917-5a26-4a85-878a-7d21023a7fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "50b51917-5a26-4a85-878a-7d21023a7fb1", "address": "fa:16:3e:5e:58:be", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b51917-5a", "ovs_interfaceid": "50b51917-5a26-4a85-878a-7d21023a7fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:58:be,bridge_name='br-int',has_traffic_filtering=True,id=50b51917-5a26-4a85-878a-7d21023a7fb1,network=Network(5e734b04-2d73-42af-b120-2063ab3d7c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b51917-5a') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG os_vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:58:be,bridge_name='br-int',has_traffic_filtering=True,id=50b51917-5a26-4a85-878a-7d21023a7fb1,network=Network(5e734b04-2d73-42af-b120-2063ab3d7c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b51917-5a') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50b51917-5a, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50b51917-5a, col_values=(('external_ids', {'iface-id': '50b51917-5a26-4a85-878a-7d21023a7fb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:58:be', 'vm-uuid': 'c655dda4-2db1-4f7c-8591-bb0512122583'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:58:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:10 user nova-compute[71692]: INFO os_vif [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:58:be,bridge_name='br-int',has_traffic_filtering=True,id=50b51917-5a26-4a85-878a-7d21023a7fb1,network=Network(5e734b04-2d73-42af-b120-2063ab3d7c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b51917-5a')
Apr 13 18:58:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] No BDM found with device name hda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:58:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:58:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] No VIF found with MAC fa:16:3e:b4:c4:a8, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:58:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] No VIF found with MAC fa:16:3e:62:0c:34, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:58:10 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Using config drive
Apr 13 18:58:10 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Creating config drive at /opt/stack/data/nova/instances/c655dda4-2db1-4f7c-8591-bb0512122583/disk.config
Apr 13 18:58:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c655dda4-2db1-4f7c-8591-bb0512122583/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsnxt7lj5 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c655dda4-2db1-4f7c-8591-bb0512122583/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsnxt7lj5" returned: 0 in 0.061s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-ab8a2dcf-7752-4d1a-be13-ec5b59ddfb02 req-f6a00873-7330-421d-afd9-e16137a2642f service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-e45634b1-0f7f-4888-ae83-8567da56407d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ab8a2dcf-7752-4d1a-be13-ec5b59ddfb02 req-f6a00873-7330-421d-afd9-e16137a2642f service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ab8a2dcf-7752-4d1a-be13-ec5b59ddfb02 req-f6a00873-7330-421d-afd9-e16137a2642f service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ab8a2dcf-7752-4d1a-be13-ec5b59ddfb02 req-f6a00873-7330-421d-afd9-e16137a2642f service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-ab8a2dcf-7752-4d1a-be13-ec5b59ddfb02 req-f6a00873-7330-421d-afd9-e16137a2642f service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-e45634b1-0f7f-4888-ae83-8567da56407d {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:12 user nova-compute[71692]: WARNING nova.compute.manager [req-ab8a2dcf-7752-4d1a-be13-ec5b59ddfb02 req-f6a00873-7330-421d-afd9-e16137a2642f service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-e45634b1-0f7f-4888-ae83-8567da56407d for instance with vm_state building and task_state spawning.
Apr 13 18:58:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-0f37185b-af6c-4f1e-9b37-8502d0f6685c req-e4017b9f-a7bd-4160-bcde-3d62adcdbab2 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-624b1877-60ef-44ae-b9fa-c07cacb7fb72 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0f37185b-af6c-4f1e-9b37-8502d0f6685c req-e4017b9f-a7bd-4160-bcde-3d62adcdbab2 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0f37185b-af6c-4f1e-9b37-8502d0f6685c req-e4017b9f-a7bd-4160-bcde-3d62adcdbab2 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0f37185b-af6c-4f1e-9b37-8502d0f6685c req-e4017b9f-a7bd-4160-bcde-3d62adcdbab2 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-0f37185b-af6c-4f1e-9b37-8502d0f6685c req-e4017b9f-a7bd-4160-bcde-3d62adcdbab2 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-624b1877-60ef-44ae-b9fa-c07cacb7fb72 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:12 user nova-compute[71692]: WARNING nova.compute.manager [req-0f37185b-af6c-4f1e-9b37-8502d0f6685c req-e4017b9f-a7bd-4160-bcde-3d62adcdbab2 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-624b1877-60ef-44ae-b9fa-c07cacb7fb72 for instance with vm_state building and task_state spawning.
Apr 13 18:58:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-0c698cfe-634a-43f2-9898-2ecd35d60724 req-6583fff5-da76-42e5-86db-8ab72b51b1ff service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-0411f083-60b0-41d4-af75-a509ace59ad5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0c698cfe-634a-43f2-9898-2ecd35d60724 req-6583fff5-da76-42e5-86db-8ab72b51b1ff service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0c698cfe-634a-43f2-9898-2ecd35d60724 req-6583fff5-da76-42e5-86db-8ab72b51b1ff service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0c698cfe-634a-43f2-9898-2ecd35d60724 req-6583fff5-da76-42e5-86db-8ab72b51b1ff service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-0c698cfe-634a-43f2-9898-2ecd35d60724 req-6583fff5-da76-42e5-86db-8ab72b51b1ff service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-0411f083-60b0-41d4-af75-a509ace59ad5 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:13 user nova-compute[71692]: WARNING nova.compute.manager [req-0c698cfe-634a-43f2-9898-2ecd35d60724 req-6583fff5-da76-42e5-86db-8ab72b51b1ff service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-0411f083-60b0-41d4-af75-a509ace59ad5 for instance with vm_state building and task_state spawning.
Apr 13 18:58:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-e45634b1-0f7f-4888-ae83-8567da56407d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-e45634b1-0f7f-4888-ae83-8567da56407d {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:14 user nova-compute[71692]: WARNING nova.compute.manager [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-e45634b1-0f7f-4888-ae83-8567da56407d for instance with vm_state building and task_state spawning.
Apr 13 18:58:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-7512b86a-c124-4ae8-907e-8490d9444e87 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-7512b86a-c124-4ae8-907e-8490d9444e87 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:14 user nova-compute[71692]: WARNING nova.compute.manager [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-7512b86a-c124-4ae8-907e-8490d9444e87 for instance with vm_state building and task_state spawning.
Apr 13 18:58:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-7512b86a-c124-4ae8-907e-8490d9444e87 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-7512b86a-c124-4ae8-907e-8490d9444e87 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:14 user nova-compute[71692]: WARNING nova.compute.manager [req-2675d265-0238-4f82-a403-1f5ba6a15e95 req-92334195-492e-4855-99dc-654ff0f90053 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-7512b86a-c124-4ae8-907e-8490d9444e87 for instance with vm_state building and task_state spawning.
Apr 13 18:58:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-624b1877-60ef-44ae-b9fa-c07cacb7fb72 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-624b1877-60ef-44ae-b9fa-c07cacb7fb72 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:14 user nova-compute[71692]: WARNING nova.compute.manager [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-624b1877-60ef-44ae-b9fa-c07cacb7fb72 for instance with vm_state building and task_state spawning.
Apr 13 18:58:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-278cf193-9dcb-4703-b7d3-d3568a793952 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-278cf193-9dcb-4703-b7d3-d3568a793952 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:14 user nova-compute[71692]: WARNING nova.compute.manager [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-278cf193-9dcb-4703-b7d3-d3568a793952 for instance with vm_state building and task_state spawning.
Apr 13 18:58:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-278cf193-9dcb-4703-b7d3-d3568a793952 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-278cf193-9dcb-4703-b7d3-d3568a793952 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:14 user nova-compute[71692]: WARNING nova.compute.manager [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-278cf193-9dcb-4703-b7d3-d3568a793952 for instance with vm_state building and task_state spawning.
Apr 13 18:58:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-50b51917-5a26-4a85-878a-7d21023a7fb1 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-50b51917-5a26-4a85-878a-7d21023a7fb1 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:14 user nova-compute[71692]: WARNING nova.compute.manager [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-50b51917-5a26-4a85-878a-7d21023a7fb1 for instance with vm_state building and task_state spawning.
Apr 13 18:58:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-50b51917-5a26-4a85-878a-7d21023a7fb1 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-50b51917-5a26-4a85-878a-7d21023a7fb1 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:14 user nova-compute[71692]: WARNING nova.compute.manager [req-0d4a79ff-98bc-44fe-a837-434b26003d5b req-af37060a-07d3-49db-9410-233fca7b65d3 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-50b51917-5a26-4a85-878a-7d21023a7fb1 for instance with vm_state building and task_state spawning.
Apr 13 18:58:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-0411f083-60b0-41d4-af75-a509ace59ad5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-0411f083-60b0-41d4-af75-a509ace59ad5 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:15 user nova-compute[71692]: WARNING nova.compute.manager [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-0411f083-60b0-41d4-af75-a509ace59ad5 for instance with vm_state building and task_state spawning.
Apr 13 18:58:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-8f025dce-fc38-4414-8e60-c924fd38d5dd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-8f025dce-fc38-4414-8e60-c924fd38d5dd {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:15 user nova-compute[71692]: WARNING nova.compute.manager [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-8f025dce-fc38-4414-8e60-c924fd38d5dd for instance with vm_state building and task_state spawning.
Apr 13 18:58:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-8f025dce-fc38-4414-8e60-c924fd38d5dd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-8f025dce-fc38-4414-8e60-c924fd38d5dd {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:15 user nova-compute[71692]: WARNING nova.compute.manager [req-2a6a29ea-797f-4726-9bae-c7ca5070ef34 req-bc9ef589-a7c0-443b-87c1-76bec819085f service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-8f025dce-fc38-4414-8e60-c924fd38d5dd for instance with vm_state building and task_state spawning.
Apr 13 18:58:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412295.9700503, c655dda4-2db1-4f7c-8591-bb0512122583 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:58:15 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] VM Resumed (Lifecycle Event)
Apr 13 18:58:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:58:15 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Instance spawned successfully.
Apr 13 18:58:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:58:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:58:16 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:58:16 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:58:16 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:58:16 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:58:16 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:58:16 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:58:16 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:58:16 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:58:16 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412295.9717102, c655dda4-2db1-4f7c-8591-bb0512122583 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:58:16 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] VM Started (Lifecycle Event)
Apr 13 18:58:16 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:58:16 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:58:16 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:58:16 user nova-compute[71692]: INFO nova.compute.manager [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Took 10.52 seconds to spawn the instance on the hypervisor.
Apr 13 18:58:16 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:58:16 user nova-compute[71692]: INFO nova.compute.manager [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Took 27.15 seconds to build instance.
Apr 13 18:58:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f13b7d9e-efc5-40ec-af73-fd0ee4ddeacd tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "c655dda4-2db1-4f7c-8591-bb0512122583" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.263s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "b7d32500-da20-4a99-af04-5f422ac6ba0a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:25 user nova-compute[71692]: DEBUG nova.objects.instance [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lazy-loading 'flavor' on Instance uuid b7d32500-da20-4a99-af04-5f422ac6ba0a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:58:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "b7d32500-da20-4a99-af04-5f422ac6ba0a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:26 user nova-compute[71692]: INFO nova.compute.manager [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Attaching volume 09a3e062-a767-4145-ad2f-5e7e9dd0ed38 to /dev/vdb
Apr 13 18:58:26 user nova-compute[71692]: DEBUG os_brick.utils [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9531f7-7f72-4268-ab9c-e653479ed8e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df1d6c1-1a8c-4724-acc7-3e2eedca8f6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2762d7-0b15-41b1-8075-9e6b3b96732a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32907b1-4954-4df1-9cde-b47ad4ad2f2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:58:26 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:58:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b722fc-f352-411c-b99e-6eafa2ef098d]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG os_brick.utils [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:58:26 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Updating existing volume attachment record: 268a6c02-3da5-4c63-8d82-83ea1b332255 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:58:27 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:58:27 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:58:27 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:58:27 user nova-compute[71692]: DEBUG nova.compute.manager [req-41870c49-d0c4-4e53-8ee5-b89bb7414aa5 req-b9623716-12b6-4dfc-8269-54c672151a83 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received event network-changed-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:27 user nova-compute[71692]: DEBUG nova.compute.manager [req-41870c49-d0c4-4e53-8ee5-b89bb7414aa5 req-b9623716-12b6-4dfc-8269-54c672151a83 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Refreshing instance network info cache due to event network-changed-a9907d23-585e-46b6-935d-d2d1f7d840f2. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:58:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-41870c49-d0c4-4e53-8ee5-b89bb7414aa5 req-b9623716-12b6-4dfc-8269-54c672151a83 service nova] Acquiring lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:58:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-41870c49-d0c4-4e53-8ee5-b89bb7414aa5 req-b9623716-12b6-4dfc-8269-54c672151a83 service nova] Acquired lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:58:27 user nova-compute[71692]: DEBUG nova.network.neutron [req-41870c49-d0c4-4e53-8ee5-b89bb7414aa5 req-b9623716-12b6-4dfc-8269-54c672151a83 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Refreshing network info cache for port a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:58:28 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:58:28 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:58:28 user nova-compute[71692]: DEBUG nova.network.neutron [req-41870c49-d0c4-4e53-8ee5-b89bb7414aa5 req-b9623716-12b6-4dfc-8269-54c672151a83 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Updated VIF entry in instance network info cache for port a9907d23-585e-46b6-935d-d2d1f7d840f2. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:58:28 user nova-compute[71692]: DEBUG nova.network.neutron [req-41870c49-d0c4-4e53-8ee5-b89bb7414aa5 req-b9623716-12b6-4dfc-8269-54c672151a83 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Updating instance_info_cache with network_info: [{"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:58:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-41870c49-d0c4-4e53-8ee5-b89bb7414aa5 req-b9623716-12b6-4dfc-8269-54c672151a83 service nova] Releasing lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG nova.objects.instance [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'flavor' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:29 user nova-compute[71692]: INFO nova.compute.manager [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Attaching volume e0036a0d-e82a-4dee-b536-e4252af1ca02 to /dev/vdb
Apr 13 18:58:29 user nova-compute[71692]: DEBUG os_brick.utils [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[66282474-1b4d-415d-b1f7-723f61f2181f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4cf1c5-bdbe-490a-b8c4-5aec20b25c47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aae2c8-7083-4d90-a2e9-ee79142a65dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee8b69c-ba93-4ac0-b4a5-9d16918a1c51]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:58:30 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:58:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ebe36c-f3da-42e0-baec-285961a39c79]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG os_brick.utils [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Updating existing volume attachment record: 0da983dd-4d05-4844-b06f-878436cfee17 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:30 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTfNygYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:58:31 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:58:31 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:58:31 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4865c1-38fb-4c66-9d74-eab7e19906f5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:58:31 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec295d9a-4ec3-48ad-beae-a8f608983822]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38] added
Apr 13 18:58:31 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9984cf2c-857f-4f31-a9f7-de4209f57586]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4809842-8025-4d84-990d-94ac7436618d]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTfNygYI {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTfNygYI" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dafe18-9810-4519-a634-0d5676a8bf32]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PTfNygYI'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb00def-67c6-4e03-a614-43639e873eb5]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ad7b3b-d3c9-435f-b83b-a41dabf77223]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:31 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:58:31 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:58:31 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:31 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:58:31 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:58:31 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1439b1e4-a263-450b-9b4a-53f09d932d44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38, portal: 172.16.0.220,3260]
Apr 13 18:58:31 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38, portal: 172.16.0.220,3260] successful.
Apr 13 18:58:31 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec9e9c9-6c60-4f33-ada2-2747f40a85d7]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfb7c8a-1ed6-4898-be35-38c37f0da58c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:31 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:58:31 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:58:31 user nova-compute[71692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 (non-flash)
Apr 13 18:58:31 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:31 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:58:31 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:58:31 user nova-compute[71692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 (non-flash)
Apr 13 18:58:31 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c04051d-1383-4d75-a667-7a1f62e5a3f6]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTfNygYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23266336664643832', 'path': '/dev/sde'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266336664643832', 'path': '/dev/sde'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG nova.objects.instance [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lazy-loading 'flavor' on Instance uuid b7d32500-da20-4a99-af04-5f422ac6ba0a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:58:32 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:58:32 user nova-compute[71692]:   <source dev="/dev/sde"/>
Apr 13 18:58:32 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:58:32 user nova-compute[71692]:   <serial>09a3e062-a767-4145-ad2f-5e7e9dd0ed38</serial>
Apr 13 18:58:32 user nova-compute[71692]: </disk>
Apr 13 18:58:32 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:58:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:58:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] No VIF found with MAC fa:16:3e:33:03:fd, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:58:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:33 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:58:33 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:58:33 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=7791MB free_disk=26.379169464111328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:58:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4c7f0f40-ee02-4eee-a723-b0a54e1c85a6 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.788s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:33 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 106da0b9-c823-4f26-874c-53f8ad235e61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance c655dda4-2db1-4f7c-8591-bb0512122583 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance a15c1b5e-1769-490a-b81f-09333cd4a227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance f17525a6-e377-4b33-85cd-88a7aaf4569a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance b7d32500-da20-4a99-af04-5f422ac6ba0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 570101b9-9c60-4c05-94ab-437a8a07d453 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.compute.manager [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.584s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:58:34 user nova-compute[71692]: INFO nova.compute.claims [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Claim successful on node user
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.compute.manager [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.compute.manager [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.network.neutron [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:58:34 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:58:34 user nova-compute[71692]: DEBUG nova.compute.manager [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.policy [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e7f76b4b7fb4651b3bce0e72f8a4de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1308cc4c5734de9a9fd83688c8da796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:58:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Creating image(s)
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "/opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "/opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "b7d32500-da20-4a99-af04-5f422ac6ba0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "b7d32500-da20-4a99-af04-5f422ac6ba0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:35 user nova-compute[71692]: INFO nova.compute.manager [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Terminating instance
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmIMbCua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:58:35 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:58:35 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:58:35 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.147s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba97095-7c10-4deb-8905-7bdafcd2749c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:58:35 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fcf481-baa0-40ca-94a3-357bdb560cdc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02] added
Apr 13 18:58:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce340652-0a43-475f-b81f-06234f753588]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[081d70e4-2c5e-4a0c-816d-700ca23d6381]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tmIMbCua {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tmIMbCua" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bf480c-2614-4916-a0a0-d599655da517]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tmIMbCua'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5973f55e-7096-4ca7-b08e-ccf225b97600]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb/disk 1073741824" returned: 0 in 0.068s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6c986b-25aa-44f8-a4dd-f90433207390]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:35 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:58:35 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:58:35 user nova-compute[71692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 (non-flash)
Apr 13 18:58:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:35 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:58:35 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:58:35 user nova-compute[71692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 (non-flash)
Apr 13 18:58:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e90e28-963b-41d6-8336-667b897fbf04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02, portal: 172.16.0.220,3260]
Apr 13 18:58:35 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02, portal: 172.16.0.220,3260] successful.
Apr 13 18:58:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd9e829-473e-4ead-9cab-1b177758d0a0]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.169s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22e9a22-346d-4fb3-af74-a6a5c01d0dd4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:35 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:58:35 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:58:35 user nova-compute[71692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 (non-flash)
Apr 13 18:58:35 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:58:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:35 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:58:35 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:58:35 user nova-compute[71692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 (non-flash)
Apr 13 18:58:35 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:58:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.440s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.compute.manager [req-a17b585e-4b84-4585-b439-a35fdd2313a7 req-b0250e61-03ae-4f6e-9ad9-f389377e0c24 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Received event network-vif-unplugged-1572a520-f7d8-4a48-995e-9a83a99a41c8 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a17b585e-4b84-4585-b439-a35fdd2313a7 req-b0250e61-03ae-4f6e-9ad9-f389377e0c24 service nova] Acquiring lock "b7d32500-da20-4a99-af04-5f422ac6ba0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a17b585e-4b84-4585-b439-a35fdd2313a7 req-b0250e61-03ae-4f6e-9ad9-f389377e0c24 service nova] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a17b585e-4b84-4585-b439-a35fdd2313a7 req-b0250e61-03ae-4f6e-9ad9-f389377e0c24 service nova] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.compute.manager [req-a17b585e-4b84-4585-b439-a35fdd2313a7 req-b0250e61-03ae-4f6e-9ad9-f389377e0c24 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] No waiting events found dispatching network-vif-unplugged-1572a520-f7d8-4a48-995e-9a83a99a41c8 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.compute.manager [req-a17b585e-4b84-4585-b439-a35fdd2313a7 req-b0250e61-03ae-4f6e-9ad9-f389377e0c24 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Received event network-vif-unplugged-1572a520-f7d8-4a48-995e-9a83a99a41c8 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4fcd0b-fbd7-425b-a7e2-9ff620a076ea]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmIMbCua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Cannot resize image /opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.objects.instance [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lazy-loading 'migration_context' on Instance uuid 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Ensure instance console log exists: /opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.network.neutron [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Successfully created port: 6d3713a2-ef39-4f8b-964a-e4bcd4082bea {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:58:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Instance destroyed successfully.
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.objects.instance [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lazy-loading 'resources' on Instance uuid b7d32500-da20-4a99-af04-5f422ac6ba0a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-223135583',display_name='tempest-DeleteServersTestJSON-server-223135583',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-223135583',id=1,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:56:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b577e81535534db29f5c81837949e958',ramdisk_id='',reservation_id='r-sdrj0lcy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-719282196',owner_user_name='tempest-DeleteServersTestJSON-719282196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:56:53Z,user_data=None,user_id='c1424be1648d4e8081f6a679b1407d3a',uuid=b7d32500-da20-4a99-af04-5f422ac6ba0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "address": "fa:16:3e:33:03:fd", "network": {"id": "4f040dc3-577a-48e7-b46d-413f3b11a1fe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1853453695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577e81535534db29f5c81837949e958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1572a520-f7", "ovs_interfaceid": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Converting VIF {"id": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "address": "fa:16:3e:33:03:fd", "network": {"id": "4f040dc3-577a-48e7-b46d-413f3b11a1fe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1853453695-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b577e81535534db29f5c81837949e958", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1572a520-f7", "ovs_interfaceid": "1572a520-f7d8-4a48-995e-9a83a99a41c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:03:fd,bridge_name='br-int',has_traffic_filtering=True,id=1572a520-f7d8-4a48-995e-9a83a99a41c8,network=Network(4f040dc3-577a-48e7-b46d-413f3b11a1fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1572a520-f7') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_vif [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:03:fd,bridge_name='br-int',has_traffic_filtering=True,id=1572a520-f7d8-4a48-995e-9a83a99a41c8,network=Network(4f040dc3-577a-48e7-b46d-413f3b11a1fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1572a520-f7') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1572a520-f7, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:58:35 user nova-compute[71692]: INFO os_vif [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:03:fd,bridge_name='br-int',has_traffic_filtering=True,id=1572a520-f7d8-4a48-995e-9a83a99a41c8,network=Network(4f040dc3-577a-48e7-b46d-413f3b11a1fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1572a520-f7')
Apr 13 18:58:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTfNygYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:58:35 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:58:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Updating instance_info_cache with network_info: [{"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG nova.network.neutron [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Successfully updated port: 6d3713a2-ef39-4f8b-964a-e4bcd4082bea {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "refresh_cache-0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquired lock "refresh_cache-0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG nova.network.neutron [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.483s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] <== connect_volume: return (1485ms) {'type': 'block', 'scsi_wwn': '23632633536333739', 'path': '/dev/sdf'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632633536333739', 'path': '/dev/sdf'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.729s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG nova.compute.manager [req-aacdb042-d2ac-49a8-81d2-7b0cad909d07 req-a1684c88-0ce5-4eaf-bfe5-7ba86fe28f79 service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Received event network-changed-6d3713a2-ef39-4f8b-964a-e4bcd4082bea {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG nova.compute.manager [req-aacdb042-d2ac-49a8-81d2-7b0cad909d07 req-a1684c88-0ce5-4eaf-bfe5-7ba86fe28f79 service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Refreshing instance network info cache due to event network-changed-6d3713a2-ef39-4f8b-964a-e4bcd4082bea. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-aacdb042-d2ac-49a8-81d2-7b0cad909d07 req-a1684c88-0ce5-4eaf-bfe5-7ba86fe28f79 service nova] Acquiring lock "refresh_cache-0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG nova.objects.instance [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'flavor' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG nova.network.neutron [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5645a8-7bd1-4e96-9c8d-b87860b61455]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:58:36 user nova-compute[71692]: No targets found.
Apr 13 18:58:36 user nova-compute[71692]: iSNS:
Apr 13 18:58:36 user nova-compute[71692]: No targets found.
Apr 13 18:58:36 user nova-compute[71692]: STATIC:
Apr 13 18:58:36 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38
Apr 13 18:58:36 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:58:36 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:58:36 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8
Apr 13 18:58:36 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:58:36 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:58:36 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65
Apr 13 18:58:36 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:58:36 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:58:36 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02
Apr 13 18:58:36 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:58:36 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:58:36 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a
Apr 13 18:58:36 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:58:36 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:58:36 user nova-compute[71692]: FIRMWARE:
Apr 13 18:58:36 user nova-compute[71692]: No targets found.
Apr 13 18:58:36 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:58:36 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:58:36 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7c77a7-e9d4-4478-9e42-2bd8b8a94796]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:58:36 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:58:36 user nova-compute[71692]:   <source dev="/dev/sdf"/>
Apr 13 18:58:36 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:58:36 user nova-compute[71692]:   <serial>e0036a0d-e82a-4dee-b536-e4252af1ca02</serial>
Apr 13 18:58:36 user nova-compute[71692]: </disk>
Apr 13 18:58:36 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b29ede-789a-437e-bb38-6ea0037ec6cb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:36 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:58:36 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:58:36 user nova-compute[71692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 (non-flash)
Apr 13 18:58:36 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:58:36 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:58:36 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:58:36 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:58:36 user nova-compute[71692]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 (non-flash)
Apr 13 18:58:36 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:58:36 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc143370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38'): ({'sde'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Removing single pathed devices sde {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[90251176-b906-4c3e-a078-3184b42ce804]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[de91431e-7b2c-4606-b421-b84aa33147f9]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Flushing IO for device /dev/sde {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e48f5d2-6508-4935-8cce-ae276b57dca0]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[048bd6f4-4104-460c-a47a-7f12156f0fb4]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] SCSI volumes sde have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[672b7efd-8f4d-40d4-a761-347ba6e1f302]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c4867a-2ceb-4b11-9963-84c752cae16f]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38, portal: 172.16.0.220,3260]
Apr 13 18:58:36 user nova-compute[71692]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38, portal: 172.16.0.220,3260] successful.
Apr 13 18:58:36 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09a3e062-a767-4145-ad2f-5e7e9dd0ed38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa93f8e6-4221-45c8-837a-4b11fcfd1996]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] <== disconnect_volume: return (1028ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:58:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:58:36 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Deleting instance files /opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a_del
Apr 13 18:58:36 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Deletion of /opt/stack/data/nova/instances/b7d32500-da20-4a99-af04-5f422ac6ba0a_del complete
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.network.neutron [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Updating instance_info_cache with network_info: [{"id": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "address": "fa:16:3e:b2:43:e9", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3713a2-ef", "ovs_interfaceid": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Releasing lock "refresh_cache-0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Instance network_info: |[{"id": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "address": "fa:16:3e:b2:43:e9", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3713a2-ef", "ovs_interfaceid": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-aacdb042-d2ac-49a8-81d2-7b0cad909d07 req-a1684c88-0ce5-4eaf-bfe5-7ba86fe28f79 service nova] Acquired lock "refresh_cache-0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.network.neutron [req-aacdb042-d2ac-49a8-81d2-7b0cad909d07 req-a1684c88-0ce5-4eaf-bfe5-7ba86fe28f79 service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Refreshing network info cache for port 6d3713a2-ef39-4f8b-964a-e4bcd4082bea {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Start _get_guest_xml network_info=[{"id": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "address": "fa:16:3e:b2:43:e9", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3713a2-ef", "ovs_interfaceid": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:58:37 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:58:37 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-987915062',display_name='tempest-ServersNegativeTestJSON-server-987915062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-987915062',id=10,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1308cc4c5734de9a9fd83688c8da796',ramdisk_id='',reservation_id='r-435qc79j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1876599222',owner_user_name='tempest-ServersNegativeTestJSON-1876599222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:58:35Z,user_data=None,user_id='3e7f76b4b7fb4651b3bce0e72f8a4de6',uuid=0d7ba594-cc5f-470e-9cd3-7ff90f341aeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "address": "fa:16:3e:b2:43:e9", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3713a2-ef", "ovs_interfaceid": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Converting VIF {"id": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "address": "fa:16:3e:b2:43:e9", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3713a2-ef", "ovs_interfaceid": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:43:e9,bridge_name='br-int',has_traffic_filtering=True,id=6d3713a2-ef39-4f8b-964a-e4bcd4082bea,network=Network(ae895ef0-18d7-4f77-bcc6-bcb3dd22026f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3713a2-ef') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.objects.instance [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71692) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 13 18:58:37 user nova-compute[71692]: INFO nova.virt.libvirt.host [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] UEFI support detected
Apr 13 18:58:37 user nova-compute[71692]: INFO nova.compute.manager [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Took 2.00 seconds to destroy the instance on the hypervisor.
Apr 13 18:58:37 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] End _get_guest_xml xml=<domain type="kvm">
Apr 13 18:58:37 user nova-compute[71692]:   <uuid>0d7ba594-cc5f-470e-9cd3-7ff90f341aeb</uuid>
Apr 13 18:58:37 user nova-compute[71692]:   <name>instance-0000000a</name>
Apr 13 18:58:37 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 18:58:37 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 18:58:37 user nova-compute[71692]:   <metadata>
Apr 13 18:58:37 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 18:58:37 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 18:58:37 user nova-compute[71692]:       <nova:name>tempest-ServersNegativeTestJSON-server-987915062</nova:name>
Apr 13 18:58:37 user nova-compute[71692]:       <nova:creationTime>2023-04-13 18:58:37</nova:creationTime>
Apr 13 18:58:37 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 18:58:37 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 18:58:37 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 18:58:37 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 18:58:37 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 18:58:37 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 18:58:37 user nova-compute[71692]:       </nova:flavor>
Apr 13 18:58:37 user nova-compute[71692]:       <nova:owner>
Apr 13 18:58:37 user nova-compute[71692]:         <nova:user uuid="3e7f76b4b7fb4651b3bce0e72f8a4de6">tempest-ServersNegativeTestJSON-1876599222-project-member</nova:user>
Apr 13 18:58:37 user nova-compute[71692]:         <nova:project uuid="a1308cc4c5734de9a9fd83688c8da796">tempest-ServersNegativeTestJSON-1876599222</nova:project>
Apr 13 18:58:37 user nova-compute[71692]:       </nova:owner>
Apr 13 18:58:37 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 18:58:37 user nova-compute[71692]:       <nova:ports>
Apr 13 18:58:37 user nova-compute[71692]:         <nova:port uuid="6d3713a2-ef39-4f8b-964a-e4bcd4082bea">
Apr 13 18:58:37 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 18:58:37 user nova-compute[71692]:         </nova:port>
Apr 13 18:58:37 user nova-compute[71692]:       </nova:ports>
Apr 13 18:58:37 user nova-compute[71692]:     </nova:instance>
Apr 13 18:58:37 user nova-compute[71692]:   </metadata>
Apr 13 18:58:37 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 18:58:37 user nova-compute[71692]:     <system>
Apr 13 18:58:37 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 18:58:37 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 18:58:37 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 18:58:37 user nova-compute[71692]:       <entry name="serial">0d7ba594-cc5f-470e-9cd3-7ff90f341aeb</entry>
Apr 13 18:58:37 user nova-compute[71692]:       <entry name="uuid">0d7ba594-cc5f-470e-9cd3-7ff90f341aeb</entry>
Apr 13 18:58:37 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 18:58:37 user nova-compute[71692]:     </system>
Apr 13 18:58:37 user nova-compute[71692]:   </sysinfo>
Apr 13 18:58:37 user nova-compute[71692]:   <os>
Apr 13 18:58:37 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 18:58:37 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 18:58:37 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 18:58:37 user nova-compute[71692]:   </os>
Apr 13 18:58:37 user nova-compute[71692]:   <features>
Apr 13 18:58:37 user nova-compute[71692]:     <acpi/>
Apr 13 18:58:37 user nova-compute[71692]:     <apic/>
Apr 13 18:58:37 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 18:58:37 user nova-compute[71692]:   </features>
Apr 13 18:58:37 user nova-compute[71692]:   <clock offset="utc">
Apr 13 18:58:37 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 18:58:37 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 18:58:37 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 18:58:37 user nova-compute[71692]:   </clock>
Apr 13 18:58:37 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 18:58:37 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 18:58:37 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 18:58:37 user nova-compute[71692]:   </cpu>
Apr 13 18:58:37 user nova-compute[71692]:   <devices>
Apr 13 18:58:37 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 18:58:37 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 18:58:37 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb/disk"/>
Apr 13 18:58:37 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 18:58:37 user nova-compute[71692]:     </disk>
Apr 13 18:58:37 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 18:58:37 user nova-compute[71692]:       <mac address="fa:16:3e:b2:43:e9"/>
Apr 13 18:58:37 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:58:37 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 18:58:37 user nova-compute[71692]:       <target dev="tap6d3713a2-ef"/>
Apr 13 18:58:37 user nova-compute[71692]:     </interface>
Apr 13 18:58:37 user nova-compute[71692]:     <serial type="pty">
Apr 13 18:58:37 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb/console.log" append="off"/>
Apr 13 18:58:37 user nova-compute[71692]:     </serial>
Apr 13 18:58:37 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 18:58:37 user nova-compute[71692]:     <video>
Apr 13 18:58:37 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 18:58:37 user nova-compute[71692]:     </video>
Apr 13 18:58:37 user nova-compute[71692]:     <rng model="virtio">
Apr 13 18:58:37 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 18:58:37 user nova-compute[71692]:     </rng>
Apr 13 18:58:37 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 18:58:37 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 18:58:37 user nova-compute[71692]:       <stats period="10"/>
Apr 13 18:58:37 user nova-compute[71692]:     </memballoon>
Apr 13 18:58:37 user nova-compute[71692]:   </devices>
Apr 13 18:58:37 user nova-compute[71692]: </domain>
Apr 13 18:58:37 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-987915062',display_name='tempest-ServersNegativeTestJSON-server-987915062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-987915062',id=10,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1308cc4c5734de9a9fd83688c8da796',ramdisk_id='',reservation_id='r-435qc79j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1876599222',owner_user_name='tempest-ServersNegativeTestJSON-1876599222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:58:35Z,user_data=None,user_id='3e7f76b4b7fb4651b3bce0e72f8a4de6',uuid=0d7ba594-cc5f-470e-9cd3-7ff90f341aeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "address": "fa:16:3e:b2:43:e9", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3713a2-ef", "ovs_interfaceid": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Converting VIF {"id": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "address": "fa:16:3e:b2:43:e9", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3713a2-ef", "ovs_interfaceid": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:43:e9,bridge_name='br-int',has_traffic_filtering=True,id=6d3713a2-ef39-4f8b-964a-e4bcd4082bea,network=Network(ae895ef0-18d7-4f77-bcc6-bcb3dd22026f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3713a2-ef') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG os_vif [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:43:e9,bridge_name='br-int',has_traffic_filtering=True,id=6d3713a2-ef39-4f8b-964a-e4bcd4082bea,network=Network(ae895ef0-18d7-4f77-bcc6-bcb3dd22026f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3713a2-ef') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d3713a2-ef, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d3713a2-ef, col_values=(('external_ids', {'iface-id': '6d3713a2-ef39-4f8b-964a-e4bcd4082bea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:43:e9', 'vm-uuid': '0d7ba594-cc5f-470e-9cd3-7ff90f341aeb'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:37 user nova-compute[71692]: INFO os_vif [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:43:e9,bridge_name='br-int',has_traffic_filtering=True,id=6d3713a2-ef39-4f8b-964a-e4bcd4082bea,network=Network(ae895ef0-18d7-4f77-bcc6-bcb3dd22026f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3713a2-ef')
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] No VIF found with MAC fa:16:3e:7b:3b:25, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] No VIF found with MAC fa:16:3e:b2:43:e9, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-37a78606-ee25-4c67-a603-ccecc597b173 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.511s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ee71817a-0f59-4fae-803a-362bfb609369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ee71817a-0f59-4fae-803a-362bfb609369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ee71817a-0f59-4fae-803a-362bfb609369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ee71817a-0f59-4fae-803a-362bfb609369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71692) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ee71817a-0f59-4fae-803a-362bfb609369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'flavor' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.network.neutron [req-aacdb042-d2ac-49a8-81d2-7b0cad909d07 req-a1684c88-0ce5-4eaf-bfe5-7ba86fe28f79 service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Updated VIF entry in instance network info cache for port 6d3713a2-ef39-4f8b-964a-e4bcd4082bea. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.network.neutron [req-aacdb042-d2ac-49a8-81d2-7b0cad909d07 req-a1684c88-0ce5-4eaf-bfe5-7ba86fe28f79 service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Updating instance_info_cache with network_info: [{"id": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "address": "fa:16:3e:b2:43:e9", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3713a2-ef", "ovs_interfaceid": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-aacdb042-d2ac-49a8-81d2-7b0cad909d07 req-a1684c88-0ce5-4eaf-bfe5-7ba86fe28f79 service nova] Releasing lock "refresh_cache-0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.compute.manager [req-857042e9-59e6-4116-9611-92eaccc94d25 req-c79ba749-0269-4051-8cf1-7b0d8699f5d8 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Received event network-vif-plugged-1572a520-f7d8-4a48-995e-9a83a99a41c8 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-857042e9-59e6-4116-9611-92eaccc94d25 req-c79ba749-0269-4051-8cf1-7b0d8699f5d8 service nova] Acquiring lock "b7d32500-da20-4a99-af04-5f422ac6ba0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-857042e9-59e6-4116-9611-92eaccc94d25 req-c79ba749-0269-4051-8cf1-7b0d8699f5d8 service nova] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-857042e9-59e6-4116-9611-92eaccc94d25 req-c79ba749-0269-4051-8cf1-7b0d8699f5d8 service nova] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG nova.compute.manager [req-857042e9-59e6-4116-9611-92eaccc94d25 req-c79ba749-0269-4051-8cf1-7b0d8699f5d8 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] No waiting events found dispatching network-vif-plugged-1572a520-f7d8-4a48-995e-9a83a99a41c8 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:37 user nova-compute[71692]: WARNING nova.compute.manager [req-857042e9-59e6-4116-9611-92eaccc94d25 req-c79ba749-0269-4051-8cf1-7b0d8699f5d8 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Received unexpected event network-vif-plugged-1572a520-f7d8-4a48-995e-9a83a99a41c8 for instance with vm_state active and task_state deleting.
Apr 13 18:58:37 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Took 0.61 seconds to deallocate network for instance.
Apr 13 18:58:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:38 user nova-compute[71692]: DEBUG nova.compute.manager [req-25cfe239-6b78-4fdf-842c-800ee7405d2a req-35bb6e49-e400-43b6-97ac-9e90210e6c85 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received event network-vif-unplugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-25cfe239-6b78-4fdf-842c-800ee7405d2a req-35bb6e49-e400-43b6-97ac-9e90210e6c85 service nova] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-25cfe239-6b78-4fdf-842c-800ee7405d2a req-35bb6e49-e400-43b6-97ac-9e90210e6c85 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-25cfe239-6b78-4fdf-842c-800ee7405d2a req-35bb6e49-e400-43b6-97ac-9e90210e6c85 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:38 user nova-compute[71692]: DEBUG nova.compute.manager [req-25cfe239-6b78-4fdf-842c-800ee7405d2a req-35bb6e49-e400-43b6-97ac-9e90210e6c85 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] No waiting events found dispatching network-vif-unplugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:38 user nova-compute[71692]: WARNING nova.compute.manager [req-25cfe239-6b78-4fdf-842c-800ee7405d2a req-35bb6e49-e400-43b6-97ac-9e90210e6c85 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received unexpected event network-vif-unplugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance with vm_state active and task_state powering-off.
Apr 13 18:58:38 user nova-compute[71692]: INFO nova.compute.manager [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Took 0.95 seconds to detach 1 volumes for instance.
Apr 13 18:58:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:38 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Instance destroyed successfully.
Apr 13 18:58:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ee71817a-0f59-4fae-803a-362bfb609369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:58:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ee71817a-0f59-4fae-803a-362bfb609369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.410s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:39 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:58:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:39 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:58:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:39 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Deleted allocations for instance b7d32500-da20-4a99-af04-5f422ac6ba0a
Apr 13 18:58:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-abcf9dc1-14f8-427a-839b-88c2ece646fd req-4be5ca27-ca13-4210-8040-e99389681c57 service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Received event network-vif-plugged-6d3713a2-ef39-4f8b-964a-e4bcd4082bea {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-abcf9dc1-14f8-427a-839b-88c2ece646fd req-4be5ca27-ca13-4210-8040-e99389681c57 service nova] Acquiring lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-abcf9dc1-14f8-427a-839b-88c2ece646fd req-4be5ca27-ca13-4210-8040-e99389681c57 service nova] Lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-abcf9dc1-14f8-427a-839b-88c2ece646fd req-4be5ca27-ca13-4210-8040-e99389681c57 service nova] Lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-abcf9dc1-14f8-427a-839b-88c2ece646fd req-4be5ca27-ca13-4210-8040-e99389681c57 service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] No waiting events found dispatching network-vif-plugged-6d3713a2-ef39-4f8b-964a-e4bcd4082bea {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:39 user nova-compute[71692]: WARNING nova.compute.manager [req-abcf9dc1-14f8-427a-839b-88c2ece646fd req-4be5ca27-ca13-4210-8040-e99389681c57 service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Received unexpected event network-vif-plugged-6d3713a2-ef39-4f8b-964a-e4bcd4082bea for instance with vm_state building and task_state spawning.
Apr 13 18:58:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8c530f1d-fdaf-4b77-97ce-78451f773d89 tempest-DeleteServersTestJSON-719282196 tempest-DeleteServersTestJSON-719282196-project-member] Lock "b7d32500-da20-4a99-af04-5f422ac6ba0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.259s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-dc2e33da-d2dd-497a-a849-f0388c262504 req-db1bc5c4-a3f8-4ef9-badf-6f31dcc40886 service nova] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Received event network-vif-deleted-1572a520-f7d8-4a48-995e-9a83a99a41c8 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-d2c1d410-0316-496f-ae35-eff14670be75 req-8412f89c-1ea3-4377-a47a-90422fff1754 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d2c1d410-0316-496f-ae35-eff14670be75 req-8412f89c-1ea3-4377-a47a-90422fff1754 service nova] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d2c1d410-0316-496f-ae35-eff14670be75 req-8412f89c-1ea3-4377-a47a-90422fff1754 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d2c1d410-0316-496f-ae35-eff14670be75 req-8412f89c-1ea3-4377-a47a-90422fff1754 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-d2c1d410-0316-496f-ae35-eff14670be75 req-8412f89c-1ea3-4377-a47a-90422fff1754 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] No waiting events found dispatching network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:40 user nova-compute[71692]: WARNING nova.compute.manager [req-d2c1d410-0316-496f-ae35-eff14670be75 req-8412f89c-1ea3-4377-a47a-90422fff1754 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received unexpected event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance with vm_state stopped and task_state None.
Apr 13 18:58:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412321.1733806, 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:58:41 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] VM Resumed (Lifecycle Event)
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 18:58:41 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Instance spawned successfully.
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 18:58:41 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412321.1743133, 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:58:41 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] VM Started (Lifecycle Event)
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:58:41 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 18:58:41 user nova-compute[71692]: INFO nova.compute.manager [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Took 6.24 seconds to spawn the instance on the hypervisor.
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:58:41 user nova-compute[71692]: INFO nova.compute.manager [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Took 7.05 seconds to build instance.
Apr 13 18:58:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-80850be3-4f96-41bb-9e96-5a5c2b3111e2 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.151s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received event network-changed-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Refreshing instance network info cache due to event network-changed-5a439b7e-d075-4d9e-9673-523b5aa356fd. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] Acquiring lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] Acquired lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.network.neutron [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Refreshing network info cache for port 5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.network.neutron [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Updated VIF entry in instance network info cache for port 5a439b7e-d075-4d9e-9673-523b5aa356fd. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.network.neutron [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Updating instance_info_cache with network_info: [{"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] Releasing lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:58:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Received event network-vif-plugged-6d3713a2-ef39-4f8b-964a-e4bcd4082bea {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] Acquiring lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] Lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] Lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] No waiting events found dispatching network-vif-plugged-6d3713a2-ef39-4f8b-964a-e4bcd4082bea {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:42 user nova-compute[71692]: WARNING nova.compute.manager [req-093a09bd-2022-4250-a715-acb7599d43ec req-6d6a2500-ead5-4702-b97f-b928c3e9739a service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Received unexpected event network-vif-plugged-6d3713a2-ef39-4f8b-964a-e4bcd4082bea for instance with vm_state active and task_state None.
Apr 13 18:58:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-63e2ad4d-46d4-40e6-879f-7803ed3e06e1 req-c3774587-7a59-4fe8-9463-a3cc295b0701 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-changed-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-63e2ad4d-46d4-40e6-879f-7803ed3e06e1 req-c3774587-7a59-4fe8-9463-a3cc295b0701 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Refreshing instance network info cache due to event network-changed-2b297ca1-e672-438a-917a-df2319262bc0. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:58:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-63e2ad4d-46d4-40e6-879f-7803ed3e06e1 req-c3774587-7a59-4fe8-9463-a3cc295b0701 service nova] Acquiring lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:58:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-63e2ad4d-46d4-40e6-879f-7803ed3e06e1 req-c3774587-7a59-4fe8-9463-a3cc295b0701 service nova] Acquired lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:58:42 user nova-compute[71692]: DEBUG nova.network.neutron [req-63e2ad4d-46d4-40e6-879f-7803ed3e06e1 req-c3774587-7a59-4fe8-9463-a3cc295b0701 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Refreshing network info cache for port 2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:58:42 user nova-compute[71692]: DEBUG nova.network.neutron [req-63e2ad4d-46d4-40e6-879f-7803ed3e06e1 req-c3774587-7a59-4fe8-9463-a3cc295b0701 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updated VIF entry in instance network info cache for port 2b297ca1-e672-438a-917a-df2319262bc0. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:58:42 user nova-compute[71692]: DEBUG nova.network.neutron [req-63e2ad4d-46d4-40e6-879f-7803ed3e06e1 req-c3774587-7a59-4fe8-9463-a3cc295b0701 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating instance_info_cache with network_info: [{"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:58:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-63e2ad4d-46d4-40e6-879f-7803ed3e06e1 req-c3774587-7a59-4fe8-9463-a3cc295b0701 service nova] Releasing lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:58:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:43 user nova-compute[71692]: INFO nova.compute.manager [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Shelving
Apr 13 18:58:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-464e28ad-4fe3-48aa-8d72-25864b38f2ba req-e58c81e0-dca6-42a1-b064-c2d7c6d249a4 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received event network-vif-unplugged-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-464e28ad-4fe3-48aa-8d72-25864b38f2ba req-e58c81e0-dca6-42a1-b064-c2d7c6d249a4 service nova] Acquiring lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-464e28ad-4fe3-48aa-8d72-25864b38f2ba req-e58c81e0-dca6-42a1-b064-c2d7c6d249a4 service nova] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-464e28ad-4fe3-48aa-8d72-25864b38f2ba req-e58c81e0-dca6-42a1-b064-c2d7c6d249a4 service nova] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-464e28ad-4fe3-48aa-8d72-25864b38f2ba req-e58c81e0-dca6-42a1-b064-c2d7c6d249a4 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] No waiting events found dispatching network-vif-unplugged-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:43 user nova-compute[71692]: WARNING nova.compute.manager [req-464e28ad-4fe3-48aa-8d72-25864b38f2ba req-e58c81e0-dca6-42a1-b064-c2d7c6d249a4 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received unexpected event network-vif-unplugged-5a439b7e-d075-4d9e-9673-523b5aa356fd for instance with vm_state active and task_state shelving.
Apr 13 18:58:43 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Instance destroyed successfully.
Apr 13 18:58:43 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Beginning cold snapshot process
Apr 13 18:58:43 user nova-compute[71692]: DEBUG nova.privsep.utils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 18:58:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk /opt/stack/data/nova/instances/snapshots/tmpqo48u76b/59a5a2104f7c4668bad2a28bf5ad6881 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk /opt/stack/data/nova/instances/snapshots/tmpqo48u76b/59a5a2104f7c4668bad2a28bf5ad6881" returned: 0 in 0.568s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:44 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Snapshot extracted, beginning image upload
Apr 13 18:58:45 user nova-compute[71692]: DEBUG nova.compute.manager [req-45966dbf-3d1d-4578-9312-e72bbeab9656 req-52ba2407-11ca-4b4f-b187-95d6c545bab7 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received event network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-45966dbf-3d1d-4578-9312-e72bbeab9656 req-52ba2407-11ca-4b4f-b187-95d6c545bab7 service nova] Acquiring lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-45966dbf-3d1d-4578-9312-e72bbeab9656 req-52ba2407-11ca-4b4f-b187-95d6c545bab7 service nova] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-45966dbf-3d1d-4578-9312-e72bbeab9656 req-52ba2407-11ca-4b4f-b187-95d6c545bab7 service nova] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:45 user nova-compute[71692]: DEBUG nova.compute.manager [req-45966dbf-3d1d-4578-9312-e72bbeab9656 req-52ba2407-11ca-4b4f-b187-95d6c545bab7 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] No waiting events found dispatching network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:58:45 user nova-compute[71692]: WARNING nova.compute.manager [req-45966dbf-3d1d-4578-9312-e72bbeab9656 req-52ba2407-11ca-4b4f-b187-95d6c545bab7 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received unexpected event network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 18:58:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:46 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Snapshot image upload complete
Apr 13 18:58:46 user nova-compute[71692]: DEBUG nova.compute.manager [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:58:46 user nova-compute[71692]: INFO nova.compute.manager [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Shelve offloading
Apr 13 18:58:46 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Instance destroyed successfully.
Apr 13 18:58:46 user nova-compute[71692]: DEBUG nova.compute.manager [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:58:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:58:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquired lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:58:46 user nova-compute[71692]: DEBUG nova.network.neutron [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:58:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:47 user nova-compute[71692]: DEBUG nova.network.neutron [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Updating instance_info_cache with network_info: [{"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:58:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Releasing lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:58:48 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Instance destroyed successfully.
Apr 13 18:58:48 user nova-compute[71692]: DEBUG nova.objects.instance [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'resources' on Instance uuid ca1b4132-15bd-4d4e-8d0c-d074824c888f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-167054456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-167054456',id=4,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMydqo7bmRL3ACZzwkGDc5E4wLELR7X8fXhb12zGOXMBXei6xirNWcHiWE3B5l9MrFe74EHnr4RXCIBAisEn3x6JzBkNkUkW7rpPbUx5zSUBeEYIWhZNJiv3ehZ9wfugA==',key_name='tempest-keypair-1219895845',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:57:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='faabdcc8e61c452ab3b934b1c9501e68',ramdisk_id='',reservation_id='r-mi7i79i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1546308967',owner_user_name='tempest-AttachVolumeShelveTestJSON-1546308967-project-member',shelved_at='2023-04-13T18:58:46.627461',shelved_host='user',shelved_image_id='7d0d0224-bc69-47f5-a6a5-c6f72a864595'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:58:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee6c76c605d54b4f84e0596b27087f0b',uuid=ca1b4132-15bd-4d4e-8d0c-d074824c888f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converting VIF {"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=5a439b7e-d075-4d9e-9673-523b5aa356fd,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a439b7e-d0') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG os_vif [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=5a439b7e-d075-4d9e-9673-523b5aa356fd,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a439b7e-d0') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a439b7e-d0, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG nova.compute.manager [req-b93fabf0-69a5-42f4-b9f4-ce42cc583a96 req-5184e0f7-1e3d-4f1d-85c6-5f7067d0a3d9 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received event network-changed-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG nova.compute.manager [req-b93fabf0-69a5-42f4-b9f4-ce42cc583a96 req-5184e0f7-1e3d-4f1d-85c6-5f7067d0a3d9 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Refreshing instance network info cache due to event network-changed-5a439b7e-d075-4d9e-9673-523b5aa356fd. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b93fabf0-69a5-42f4-b9f4-ce42cc583a96 req-5184e0f7-1e3d-4f1d-85c6-5f7067d0a3d9 service nova] Acquiring lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b93fabf0-69a5-42f4-b9f4-ce42cc583a96 req-5184e0f7-1e3d-4f1d-85c6-5f7067d0a3d9 service nova] Acquired lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG nova.network.neutron [req-b93fabf0-69a5-42f4-b9f4-ce42cc583a96 req-5184e0f7-1e3d-4f1d-85c6-5f7067d0a3d9 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Refreshing network info cache for port 5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:48 user nova-compute[71692]: INFO os_vif [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=5a439b7e-d075-4d9e-9673-523b5aa356fd,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a439b7e-d0')
Apr 13 18:58:48 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Deleting instance files /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f_del
Apr 13 18:58:48 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Deletion of /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f_del complete
Apr 13 18:58:48 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Deleted allocations for instance ca1b4132-15bd-4d4e-8d0c-d074824c888f
Apr 13 18:58:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG nova.objects.instance [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'numa_topology' on Instance uuid ca1b4132-15bd-4d4e-8d0c-d074824c888f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG nova.network.neutron [req-b93fabf0-69a5-42f4-b9f4-ce42cc583a96 req-5184e0f7-1e3d-4f1d-85c6-5f7067d0a3d9 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Updated VIF entry in instance network info cache for port 5a439b7e-d075-4d9e-9673-523b5aa356fd. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG nova.network.neutron [req-b93fabf0-69a5-42f4-b9f4-ce42cc583a96 req-5184e0f7-1e3d-4f1d-85c6-5f7067d0a3d9 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Updating instance_info_cache with network_info: [{"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b93fabf0-69a5-42f4-b9f4-ce42cc583a96 req-5184e0f7-1e3d-4f1d-85c6-5f7067d0a3d9 service nova] Releasing lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:58:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d32875-ebe1-48ec-954f-e725bbee2677 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.645s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:50 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412315.896747, b7d32500-da20-4a99-af04-5f422ac6ba0a => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:58:50 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] VM Stopped (Lifecycle Event)
Apr 13 18:58:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:50 user nova-compute[71692]: DEBUG nova.compute.manager [None req-7358fc9b-1f70-4553-bd04-f5572cd0a226 None None] [instance: b7d32500-da20-4a99-af04-5f422ac6ba0a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:58:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:53 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412318.90175, a15c1b5e-1769-490a-b81f-09333cd4a227 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:58:53 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] VM Stopped (Lifecycle Event)
Apr 13 18:58:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-4e9cd7b1-ee12-4c3a-a761-9bdf8c6f1a48 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:58:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-4e9cd7b1-ee12-4c3a-a761-9bdf8c6f1a48 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 18:58:55 user nova-compute[71692]: DEBUG nova.compute.manager [req-c2e812c4-52ea-451b-a762-c9e859292807 req-8eee279a-b892-42c7-adca-0e9156778393 service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Received event network-changed-8638d612-5f79-496f-8be2-db6706c14211 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:55 user nova-compute[71692]: DEBUG nova.compute.manager [req-c2e812c4-52ea-451b-a762-c9e859292807 req-8eee279a-b892-42c7-adca-0e9156778393 service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Refreshing instance network info cache due to event network-changed-8638d612-5f79-496f-8be2-db6706c14211. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:58:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c2e812c4-52ea-451b-a762-c9e859292807 req-8eee279a-b892-42c7-adca-0e9156778393 service nova] Acquiring lock "refresh_cache-106da0b9-c823-4f26-874c-53f8ad235e61" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:58:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c2e812c4-52ea-451b-a762-c9e859292807 req-8eee279a-b892-42c7-adca-0e9156778393 service nova] Acquired lock "refresh_cache-106da0b9-c823-4f26-874c-53f8ad235e61" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:58:55 user nova-compute[71692]: DEBUG nova.network.neutron [req-c2e812c4-52ea-451b-a762-c9e859292807 req-8eee279a-b892-42c7-adca-0e9156778393 service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Refreshing network info cache for port 8638d612-5f79-496f-8be2-db6706c14211 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:58:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:56 user nova-compute[71692]: DEBUG nova.network.neutron [req-c2e812c4-52ea-451b-a762-c9e859292807 req-8eee279a-b892-42c7-adca-0e9156778393 service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Updated VIF entry in instance network info cache for port 8638d612-5f79-496f-8be2-db6706c14211. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:58:56 user nova-compute[71692]: DEBUG nova.network.neutron [req-c2e812c4-52ea-451b-a762-c9e859292807 req-8eee279a-b892-42c7-adca-0e9156778393 service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Updating instance_info_cache with network_info: [{"id": "8638d612-5f79-496f-8be2-db6706c14211", "address": "fa:16:3e:c4:f2:9f", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8638d612-5f", "ovs_interfaceid": "8638d612-5f79-496f-8be2-db6706c14211", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:58:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c2e812c4-52ea-451b-a762-c9e859292807 req-8eee279a-b892-42c7-adca-0e9156778393 service nova] Releasing lock "refresh_cache-106da0b9-c823-4f26-874c-53f8ad235e61" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "106da0b9-c823-4f26-874c-53f8ad235e61" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "106da0b9-c823-4f26-874c-53f8ad235e61" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lazy-loading 'flavor' on Instance uuid 106da0b9-c823-4f26-874c-53f8ad235e61 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "106da0b9-c823-4f26-874c-53f8ad235e61" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "106da0b9-c823-4f26-874c-53f8ad235e61" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "106da0b9-c823-4f26-874c-53f8ad235e61" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:58:57 user nova-compute[71692]: INFO nova.compute.manager [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Attaching volume 94e6e922-45be-46d6-92ee-5c3d6ebfcf7e to /dev/vdb
Apr 13 18:58:57 user nova-compute[71692]: DEBUG os_brick.utils [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87c867b-8e88-42af-8603-3fd09487a735]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b886626-6cd8-4220-a679-8d15c3712adc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[843a61b6-5111-4272-bc22-4f076e2c412a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4616d1-103a-4de3-bbaa-07b0782bb57f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:58:57 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:58:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d31cacc-1365-4b9d-afa5-979b0af73961]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG os_brick.utils [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:58:57 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Updating existing volume attachment record: f6ae763d-d4fa-49df-ade7-4aaf010cccab {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:58:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:58:58 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412323.626661, ca1b4132-15bd-4d4e-8d0c-d074824c888f => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:58:58 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] VM Stopped (Lifecycle Event)
Apr 13 18:58:58 user nova-compute[71692]: DEBUG nova.compute.manager [None req-82dc02bb-7324-4499-aac9-8050dfa42f53 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:58:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-c0215425-3e36-4ae5-9b95-8ef6f93b591b req-3eb3de38-f89f-4666-944a-1174ba48ea0e service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Received event network-changed-e1757463-6986-4a9e-938a-9960bbe17cb9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:58:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-c0215425-3e36-4ae5-9b95-8ef6f93b591b req-3eb3de38-f89f-4666-944a-1174ba48ea0e service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Refreshing instance network info cache due to event network-changed-e1757463-6986-4a9e-938a-9960bbe17cb9. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:58:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c0215425-3e36-4ae5-9b95-8ef6f93b591b req-3eb3de38-f89f-4666-944a-1174ba48ea0e service nova] Acquiring lock "refresh_cache-0ed13b57-30a9-44c2-a18d-f936d33209b0" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:58:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c0215425-3e36-4ae5-9b95-8ef6f93b591b req-3eb3de38-f89f-4666-944a-1174ba48ea0e service nova] Acquired lock "refresh_cache-0ed13b57-30a9-44c2-a18d-f936d33209b0" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:58:59 user nova-compute[71692]: DEBUG nova.network.neutron [req-c0215425-3e36-4ae5-9b95-8ef6f93b591b req-3eb3de38-f89f-4666-944a-1174ba48ea0e service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Refreshing network info cache for port e1757463-6986-4a9e-938a-9960bbe17cb9 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:59:00 user nova-compute[71692]: DEBUG nova.network.neutron [req-c0215425-3e36-4ae5-9b95-8ef6f93b591b req-3eb3de38-f89f-4666-944a-1174ba48ea0e service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Updated VIF entry in instance network info cache for port e1757463-6986-4a9e-938a-9960bbe17cb9. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:59:00 user nova-compute[71692]: DEBUG nova.network.neutron [req-c0215425-3e36-4ae5-9b95-8ef6f93b591b req-3eb3de38-f89f-4666-944a-1174ba48ea0e service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Updating instance_info_cache with network_info: [{"id": "e1757463-6986-4a9e-938a-9960bbe17cb9", "address": "fa:16:3e:a9:06:fa", "network": {"id": "183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1861706338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a103d122466143fa96dabc7aec4c2b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1757463-69", "ovs_interfaceid": "e1757463-6986-4a9e-938a-9960bbe17cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:59:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c0215425-3e36-4ae5-9b95-8ef6f93b591b req-3eb3de38-f89f-4666-944a-1174ba48ea0e service nova] Releasing lock "refresh_cache-0ed13b57-30a9-44c2-a18d-f936d33209b0" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "0ed13b57-30a9-44c2-a18d-f936d33209b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG nova.objects.instance [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lazy-loading 'flavor' on Instance uuid 0ed13b57-30a9-44c2-a18d-f936d33209b0 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "0ed13b57-30a9-44c2-a18d-f936d33209b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:01 user nova-compute[71692]: INFO nova.compute.manager [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Attaching volume 5189182b-ec00-4894-b2f7-19242b4860ed to /dev/sdc
Apr 13 18:59:01 user nova-compute[71692]: DEBUG os_brick.utils [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[50afe1d9-d15a-4c56-b847-ca3daf3cdd38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e70c8f6-000c-4372-9189-736966752520]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1eed9dc-0fe6-44c7-98a7-c0eed2738039]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[af244939-2807-4519-ba76-67ad2951314d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:59:01 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:59:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[741825d9-0898-4dc8-ba09-cb420914e8b2]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG os_brick.utils [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:59:01 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Updating existing volume attachment record: d96fe0b4-0e73-4ee8-b3b5-90b604abe8a4 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhTEpVFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:59:02 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:02 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:02 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fa5c06-e5a4-4961-a638-06e1d5713ce1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:59:02 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7098067-7377-4bc8-a793-95e262456c5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e] added
Apr 13 18:59:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ece142-caf6-4736-a6d9-584925475479]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2712bb9-d141-4dc8-8bdf-60a6fbf5f4ff]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vhTEpVFk {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vhTEpVFk" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3149e71c-bd7a-4835-a846-c05e235adcac]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vhTEpVFk'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb4221a-1270-4a94-8d0c-93ac8a6a05e9]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19ae43d-1158-43f9-8953-1a867a44242c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:02 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:02 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:02 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:02 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:02 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:02 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a657f03-9271-4493-8b56-071a2ddb04b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e, portal: 172.16.0.220,3260]
Apr 13 18:59:02 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e, portal: 172.16.0.220,3260] successful.
Apr 13 18:59:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f983cedd-2023-4db5-940a-54cc1077e96f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e711df6-69fa-4439-9a1b-a80b3c87d8f4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:02 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:02 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:02 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:02 user nova-compute[71692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e (non-flash)
Apr 13 18:59:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:02 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:02 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:02 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:02 user nova-compute[71692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e (non-flash)
Apr 13 18:59:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33064bf-cb1e-4c3c-b833-78107344d151]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG nova.compute.manager [req-9ccc990f-5d60-41ca-a02c-dd6ba67db860 req-dbf2f98e-4e6f-4ed8-9075-79f17d8900d4 service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Received event network-changed-3e432daf-10a6-4797-b1f8-ad67a2b8417f {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG nova.compute.manager [req-9ccc990f-5d60-41ca-a02c-dd6ba67db860 req-dbf2f98e-4e6f-4ed8-9075-79f17d8900d4 service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Refreshing instance network info cache due to event network-changed-3e432daf-10a6-4797-b1f8-ad67a2b8417f. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9ccc990f-5d60-41ca-a02c-dd6ba67db860 req-dbf2f98e-4e6f-4ed8-9075-79f17d8900d4 service nova] Acquiring lock "refresh_cache-570101b9-9c60-4c05-94ab-437a8a07d453" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9ccc990f-5d60-41ca-a02c-dd6ba67db860 req-dbf2f98e-4e6f-4ed8-9075-79f17d8900d4 service nova] Acquired lock "refresh_cache-570101b9-9c60-4c05-94ab-437a8a07d453" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG nova.network.neutron [req-9ccc990f-5d60-41ca-a02c-dd6ba67db860 req-dbf2f98e-4e6f-4ed8-9075-79f17d8900d4 service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Refreshing network info cache for port 3e432daf-10a6-4797-b1f8-ad67a2b8417f {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "570101b9-9c60-4c05-94ab-437a8a07d453" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "570101b9-9c60-4c05-94ab-437a8a07d453" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG nova.objects.instance [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lazy-loading 'flavor' on Instance uuid 570101b9-9c60-4c05-94ab-437a8a07d453 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:59:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "570101b9-9c60-4c05-94ab-437a8a07d453" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "570101b9-9c60-4c05-94ab-437a8a07d453" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "570101b9-9c60-4c05-94ab-437a8a07d453" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:03 user nova-compute[71692]: INFO nova.compute.manager [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Attaching volume ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a to /dev/vdb
Apr 13 18:59:03 user nova-compute[71692]: DEBUG os_brick.utils [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aef38d-b344-4818-af3e-89816d40be99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[356278bf-2f66-4bbd-ae59-8e59843961cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[105f2ad3-e2e5-4ea5-bf28-931879812d92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[01da46fe-f00f-4b61-a673-2d0f067e10a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:59:03 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61feb0f-99a5-4c21-a724-e661d13d9750]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG os_brick.utils [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Updating existing volume attachment record: 9242ed19-6311-4b0c-88a0-4aa4ee3e57b0 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG nova.network.neutron [req-9ccc990f-5d60-41ca-a02c-dd6ba67db860 req-dbf2f98e-4e6f-4ed8-9075-79f17d8900d4 service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Updated VIF entry in instance network info cache for port 3e432daf-10a6-4797-b1f8-ad67a2b8417f. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG nova.network.neutron [req-9ccc990f-5d60-41ca-a02c-dd6ba67db860 req-dbf2f98e-4e6f-4ed8-9075-79f17d8900d4 service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Updating instance_info_cache with network_info: [{"id": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "address": "fa:16:3e:2f:62:f1", "network": {"id": "c63ad37e-6185-435b-bc54-f9a888e474bd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-679119519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc420cebeb8945cea96fe22173ad2b5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e432daf-10", "ovs_interfaceid": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9ccc990f-5d60-41ca-a02c-dd6ba67db860 req-dbf2f98e-4e6f-4ed8-9075-79f17d8900d4 service nova] Releasing lock "refresh_cache-570101b9-9c60-4c05-94ab-437a8a07d453" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhTEpVFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23239363834613933', 'path': '/dev/sde'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239363834613933', 'path': '/dev/sde'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lazy-loading 'flavor' on Instance uuid 106da0b9-c823-4f26-874c-53f8ad235e61 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:59:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:59:03 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:59:03 user nova-compute[71692]:   <source dev="/dev/sde"/>
Apr 13 18:59:03 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:59:03 user nova-compute[71692]:   <serial>94e6e922-45be-46d6-92ee-5c3d6ebfcf7e</serial>
Apr 13 18:59:03 user nova-compute[71692]: </disk>
Apr 13 18:59:03 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:59:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:59:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:59:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] No VIF found with MAC fa:16:3e:c4:f2:9f, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:59:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e3c48423-d1f0-44d2-b11e-ddaafa5be1f3 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "106da0b9-c823-4f26-874c-53f8ad235e61" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.526s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "106da0b9-c823-4f26-874c-53f8ad235e61" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "106da0b9-c823-4f26-874c-53f8ad235e61" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:06 user nova-compute[71692]: INFO nova.compute.manager [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Detaching volume 94e6e922-45be-46d6-92ee-5c3d6ebfcf7e
Apr 13 18:59:06 user nova-compute[71692]: INFO nova.virt.block_device [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Attempting to driver detach volume 94e6e922-45be-46d6-92ee-5c3d6ebfcf7e from mountpoint /dev/vdb
Apr 13 18:59:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Attempting to detach device vdb from instance 106da0b9-c823-4f26-874c-53f8ad235e61 from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:59:06 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:59:06 user nova-compute[71692]:   <source dev="/dev/sde"/>
Apr 13 18:59:06 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:59:06 user nova-compute[71692]:   <serial>94e6e922-45be-46d6-92ee-5c3d6ebfcf7e</serial>
Apr 13 18:59:06 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:59:06 user nova-compute[71692]: </disk>
Apr 13 18:59:06 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:59:06 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Successfully detached device vdb from instance 106da0b9-c823-4f26-874c-53f8ad235e61 from the persistent domain config.
Apr 13 18:59:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 106da0b9-c823-4f26-874c-53f8ad235e61 from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:59:06 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:59:06 user nova-compute[71692]:   <source dev="/dev/sde"/>
Apr 13 18:59:06 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:59:06 user nova-compute[71692]:   <serial>94e6e922-45be-46d6-92ee-5c3d6ebfcf7e</serial>
Apr 13 18:59:06 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:59:06 user nova-compute[71692]: </disk>
Apr 13 18:59:06 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wJVSLzRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:59:06 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:06 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:06 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[774433ae-c046-4ffa-a091-4deb68d60f62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:59:06 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5ef1ca-e4af-4e1b-8b1d-fe99129ecc69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed] added
Apr 13 18:59:06 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce90b7f-1b5c-4e3b-9c93-872c003894b8]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[626d294c-0f68-4c2b-b1f2-3b196c9a3a76]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wJVSLzRs {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wJVSLzRs" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cae360-6725-4a6d-b2ac-022d1e2921ed]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wJVSLzRs'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[db44070b-3995-42c5-b9b8-3a13fe5f9c90]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f206a7f5-cb04-4e03-bbac-79f2791a7e50]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e (non-flash)
Apr 13 18:59:06 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e (non-flash)
Apr 13 18:59:06 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[39065569-0b5b-4b0c-a7c0-ef9c72abecad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed, portal: 172.16.0.220,3260]
Apr 13 18:59:06 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed, portal: 172.16.0.220,3260] successful.
Apr 13 18:59:06 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1997527d-2a8a-48e2-a147-70885d4d49ad]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee71f126-8254-4d8c-b16a-a9122271001d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed (non-flash)
Apr 13 18:59:06 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e (non-flash)
Apr 13 18:59:06 user nova-compute[71692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed (non-flash)
Apr 13 18:59:06 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681412346.4909232, 106da0b9-c823-4f26-874c-53f8ad235e61 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 106da0b9-c823-4f26-874c-53f8ad235e61 {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 18:59:06 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Successfully detached device vdb from instance 106da0b9-c823-4f26-874c-53f8ad235e61 from the live domain config.
Apr 13 18:59:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vhTEpVFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:59:06 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcf2b54-db7e-4dbb-abc2-135124955a6d]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:59:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wJVSLzRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23435643434333762', 'path': '/dev/sdg'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435643434333762', 'path': '/dev/sdg'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.020s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG nova.objects.instance [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lazy-loading 'flavor' on Instance uuid 0ed13b57-30a9-44c2-a18d-f936d33209b0 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJLROzpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:59:07 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[19894cc2-a7b0-42ff-8bf4-fa50dc24ffb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:59:07 user nova-compute[71692]: No targets found.
Apr 13 18:59:07 user nova-compute[71692]: iSNS:
Apr 13 18:59:07 user nova-compute[71692]: No targets found.
Apr 13 18:59:07 user nova-compute[71692]: STATIC:
Apr 13 18:59:07 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8
Apr 13 18:59:07 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:07 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:07 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65
Apr 13 18:59:07 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:07 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:07 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02
Apr 13 18:59:07 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:07 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:07 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e
Apr 13 18:59:07 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:07 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:07 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed
Apr 13 18:59:07 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:07 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:07 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a
Apr 13 18:59:07 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:07 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:07 user nova-compute[71692]: FIRMWARE:
Apr 13 18:59:07 user nova-compute[71692]: No targets found.
Apr 13 18:59:07 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:59:07 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:59:07 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:59:07 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:59:07 user nova-compute[71692]:   <source dev="/dev/sdg"/>
Apr 13 18:59:07 user nova-compute[71692]:   <target dev="sdc" bus="scsi"/>
Apr 13 18:59:07 user nova-compute[71692]:   <serial>5189182b-ec00-4894-b2f7-19242b4860ed</serial>
Apr 13 18:59:07 user nova-compute[71692]:   <address type="drive" controller="0" unit="2"/>
Apr 13 18:59:07 user nova-compute[71692]: </disk>
Apr 13 18:59:07 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[075ccccf-26cc-4f99-867a-a95e79ec2609]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97a0d7f-3d40-4b82-a25b-817ac000c302]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed (non-flash)
Apr 13 18:59:07 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed (non-flash)
Apr 13 18:59:07 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc2104c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e'): ({'sde'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Removing single pathed devices sde {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf757f8-454b-432e-9366-fcab67551733]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae46cb89-3ab3-4bca-bfba-3aeb45c3671d]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Flushing IO for device /dev/sde {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a506f170-ecf0-4bc3-ad4f-0a03f8715c4d]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[662e283c-d727-4215-9302-d441984e361d]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] SCSI volumes sde have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[855b592d-7539-4c8a-9b25-ad4162bd7013]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f339af3-29b3-4d5f-9fb9-817476ce921a]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e, portal: 172.16.0.220,3260]
Apr 13 18:59:07 user nova-compute[71692]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e, portal: 172.16.0.220,3260] successful.
Apr 13 18:59:07 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94e6e922-45be-46d6-92ee-5c3d6ebfcf7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[557eb2d0-81d9-4afb-9e5a-dd49cbf68ddc]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] <== disconnect_volume: return (1321ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.288s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:07 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:07 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f2e693-1044-4d35-9ec3-c5ceebff07d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:59:07 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[32041335-583a-4b6c-9702-ae51e91adf31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a] added
Apr 13 18:59:07 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1987ea51-b825-48f9-aa9d-7560613784e0]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e72b52a-71a4-4dcf-b3f9-23f9f1d2fb64]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UJLROzpo {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UJLROzpo" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33cf285-a99d-4213-b553-e061b1a05ccf]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UJLROzpo'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f9148c-8f2d-4d97-9c66-a5666e1801ac]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[118fc27b-de8e-4dcd-809c-694e234e1cdb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed (non-flash)
Apr 13 18:59:07 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:07 user nova-compute[71692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed (non-flash)
Apr 13 18:59:07 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] No BDM found with device name sda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] No VIF found with MAC fa:16:3e:a9:06:fa, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[65750b00-c766-4960-8d9f-4add6abb911a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a, portal: 172.16.0.220,3260]
Apr 13 18:59:08 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a, portal: 172.16.0.220,3260] successful.
Apr 13 18:59:08 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[91025659-d83a-4743-a0dd-86cbbe087510]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[631f1363-7235-45f9-a35f-803b702bb714]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:08 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:08 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:08 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:08 user nova-compute[71692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed (non-flash)
Apr 13 18:59:08 user nova-compute[71692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)
Apr 13 18:59:08 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:08 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:08 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:08 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:08 user nova-compute[71692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed (non-flash)
Apr 13 18:59:08 user nova-compute[71692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)
Apr 13 18:59:08 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] HCTL ('36', '-', '-', 0) found on session 9 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18e7e506-ac77-4233-9e4c-d99001ab7b1b tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.612s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7f8408-45f0-4f09-b1a9-07120f1d7f48]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Searching for a device in session 9 and hctl ['36', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG nova.objects.instance [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lazy-loading 'flavor' on Instance uuid 106da0b9-c823-4f26-874c-53f8ad235e61 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:59:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18d364c5-9bac-4838-8c46-4314216cabce tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "106da0b9-c823-4f26-874c-53f8ad235e61" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.745s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Searching for a device in session 9 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJLROzpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] <== connect_volume: return (1612ms) {'type': 'block', 'scsi_wwn': '23061633363653030', 'path': '/dev/sde'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061633363653030', 'path': '/dev/sde'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG nova.objects.instance [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lazy-loading 'flavor' on Instance uuid 570101b9-9c60-4c05-94ab-437a8a07d453 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 18:59:09 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:59:09 user nova-compute[71692]:   <source dev="/dev/sde"/>
Apr 13 18:59:09 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:59:09 user nova-compute[71692]:   <serial>ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a</serial>
Apr 13 18:59:09 user nova-compute[71692]: </disk>
Apr 13 18:59:09 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "0ed13b57-30a9-44c2-a18d-f936d33209b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:09 user nova-compute[71692]: INFO nova.compute.manager [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Detaching volume 5189182b-ec00-4894-b2f7-19242b4860ed
Apr 13 18:59:09 user nova-compute[71692]: INFO nova.virt.block_device [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Attempting to driver detach volume 5189182b-ec00-4894-b2f7-19242b4860ed from mountpoint /dev/sdc
Apr 13 18:59:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Attempting to detach device sdc from instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:59:09 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:59:09 user nova-compute[71692]:   <source dev="/dev/sdg"/>
Apr 13 18:59:09 user nova-compute[71692]:   <target dev="sdc" bus="scsi"/>
Apr 13 18:59:09 user nova-compute[71692]:   <serial>5189182b-ec00-4894-b2f7-19242b4860ed</serial>
Apr 13 18:59:09 user nova-compute[71692]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 13 18:59:09 user nova-compute[71692]: </disk>
Apr 13 18:59:09 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:59:09 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Successfully detached device sdc from instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 from the persistent domain config.
Apr 13 18:59:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:59:09 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:59:09 user nova-compute[71692]:   <source dev="/dev/sdg"/>
Apr 13 18:59:09 user nova-compute[71692]:   <target dev="sdc" bus="scsi"/>
Apr 13 18:59:09 user nova-compute[71692]:   <serial>5189182b-ec00-4894-b2f7-19242b4860ed</serial>
Apr 13 18:59:09 user nova-compute[71692]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 13 18:59:09 user nova-compute[71692]: </disk>
Apr 13 18:59:09 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] No VIF found with MAC fa:16:3e:2f:62:f1, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07ecaeeb-b86f-42c5-ae0b-4db97ee63a05 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "570101b9-9c60-4c05-94ab-437a8a07d453" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.686s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681412349.8342812, 0ed13b57-30a9-44c2-a18d-f936d33209b0 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 18:59:09 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Successfully detached device sdc from instance 0ed13b57-30a9-44c2-a18d-f936d33209b0 from the live domain config.
Apr 13 18:59:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wJVSLzRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:59:09 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc905d5-4576-4322-acbd-1955a09384cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:59:09 user nova-compute[71692]: No targets found.
Apr 13 18:59:09 user nova-compute[71692]: iSNS:
Apr 13 18:59:09 user nova-compute[71692]: No targets found.
Apr 13 18:59:09 user nova-compute[71692]: STATIC:
Apr 13 18:59:09 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8
Apr 13 18:59:09 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:09 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:09 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65
Apr 13 18:59:09 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:09 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:09 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02
Apr 13 18:59:09 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:09 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:09 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed
Apr 13 18:59:09 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:09 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:09 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a
Apr 13 18:59:09 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:09 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:09 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a
Apr 13 18:59:09 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:09 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:09 user nova-compute[71692]: FIRMWARE:
Apr 13 18:59:09 user nova-compute[71692]: No targets found.
Apr 13 18:59:09 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:59:09 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:59:09 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[12033e6f-5a1c-4ecd-bf99-d53ed6d117ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d515d3bb-e4ff-4808-a89e-414cfd2293d6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:09 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:09 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:09 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:09 user nova-compute[71692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed (non-flash)
Apr 13 18:59:09 user nova-compute[71692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)
Apr 13 18:59:09 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:09 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:09 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:09 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:09 user nova-compute[71692]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed (non-flash)
Apr 13 18:59:09 user nova-compute[71692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)
Apr 13 18:59:09 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febd8ba1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed'): ({'sdg'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Removing single pathed devices sdg {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4349cc11-5445-46f7-ae1d-717511cb2d10]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[19375912-5937-4522-b5ff-187920a723ba]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:09 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Flushing IO for device /dev/sdg {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7e331a-8e49-43eb-ae05-e6b598cdbe83]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3508a8e-5dc1-4bc4-b261-d8baffbada62]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] SCSI volumes sdg have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36d639d-2a02-4af7-a2ca-a278d10196b6]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ab258b-d401-4b11-87da-776cdade044b]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed, portal: 172.16.0.220,3260]
Apr 13 18:59:10 user nova-compute[71692]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed, portal: 172.16.0.220,3260] successful.
Apr 13 18:59:10 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5189182b-ec00-4894-b2f7-19242b4860ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad91a41-d094-4467-a06e-a9cdb3da53f8]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] <== disconnect_volume: return (358ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Acquiring lock "570101b9-9c60-4c05-94ab-437a8a07d453" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "570101b9-9c60-4c05-94ab-437a8a07d453" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG os_brick.utils [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG nova.objects.instance [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lazy-loading 'flavor' on Instance uuid 0ed13b57-30a9-44c2-a18d-f936d33209b0 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[abca3373-2231-443e-81e3-6678ed5260eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a4a4e4-29cb-420c-b575-9869d5a0ad49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1950f99d-320d-41d9-b700-ee92dd262b87 tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.712s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af8629a-bac8-4c97-98af-ca9cb0beb05d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e452fdd-b4c5-4411-aa44-ff9c78025f11]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:59:11 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b342de-a3bd-496c-96b2-e7d8af1e4a8c]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG os_brick.utils [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:59:11 user nova-compute[71692]: INFO nova.compute.manager [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Swapping volume ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a for ef58d148-d663-41c3-bfdd-6e769782a5f3
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "0ed13b57-30a9-44c2-a18d-f936d33209b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "0ed13b57-30a9-44c2-a18d-f936d33209b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:11 user nova-compute[71692]: INFO nova.compute.manager [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Terminating instance
Apr 13 18:59:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-91ef4a0a-855e-4b64-b842-c61b3beeb0ee req-f2f710ea-0779-4a8c-afb5-0ed6a4204bb6 service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Received event network-vif-unplugged-e1757463-6986-4a9e-938a-9960bbe17cb9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-91ef4a0a-855e-4b64-b842-c61b3beeb0ee req-f2f710ea-0779-4a8c-afb5-0ed6a4204bb6 service nova] Acquiring lock "0ed13b57-30a9-44c2-a18d-f936d33209b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-91ef4a0a-855e-4b64-b842-c61b3beeb0ee req-f2f710ea-0779-4a8c-afb5-0ed6a4204bb6 service nova] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-91ef4a0a-855e-4b64-b842-c61b3beeb0ee req-f2f710ea-0779-4a8c-afb5-0ed6a4204bb6 service nova] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-91ef4a0a-855e-4b64-b842-c61b3beeb0ee req-f2f710ea-0779-4a8c-afb5-0ed6a4204bb6 service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] No waiting events found dispatching network-vif-unplugged-e1757463-6986-4a9e-938a-9960bbe17cb9 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-91ef4a0a-855e-4b64-b842-c61b3beeb0ee req-f2f710ea-0779-4a8c-afb5-0ed6a4204bb6 service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Received event network-vif-unplugged-e1757463-6986-4a9e-938a-9960bbe17cb9 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:59:12 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Instance destroyed successfully.
Apr 13 18:59:12 user nova-compute[71692]: DEBUG nova.objects.instance [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lazy-loading 'resources' on Instance uuid 0ed13b57-30a9-44c2-a18d-f936d33209b0 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-725397932',display_name='tempest-AttachSCSIVolumeTestJSON-server-725397932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-725397932',id=7,image_ref='277fa2a8-beff-4b89-80f3-69462dbc910b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOZw12y7JvN6iF5rvKpcO6rMNM7Ywi+ISHUKbndrEzQqj2J1+o6PLYpYgMYAzLmFd1Mu6qfqZLcgvarOntymA742YPlT0hQA2ze5D9iB8PHU56r5M+SfrjbYL32Z9e3dQ==',key_name='tempest-keypair-1173318920',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:57:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a103d122466143fa96dabc7aec4c2b80',ramdisk_id='',reservation_id='r-xq5b9vzn',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='277fa2a8-beff-4b89-80f3-69462dbc910b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-655554039',owner_user_name='tempest-AttachSCSIVolumeTestJSON-655554039-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:57:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfd7cd2f777f4101bc727349911ae5c3',uuid=0ed13b57-30a9-44c2-a18d-f936d33209b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1757463-6986-4a9e-938a-9960bbe17cb9", "address": "fa:16:3e:a9:06:fa", "network": {"id": "183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1861706338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a103d122466143fa96dabc7aec4c2b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1757463-69", "ovs_interfaceid": "e1757463-6986-4a9e-938a-9960bbe17cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Converting VIF {"id": "e1757463-6986-4a9e-938a-9960bbe17cb9", "address": "fa:16:3e:a9:06:fa", "network": {"id": "183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1861706338-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a103d122466143fa96dabc7aec4c2b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1757463-69", "ovs_interfaceid": "e1757463-6986-4a9e-938a-9960bbe17cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:06:fa,bridge_name='br-int',has_traffic_filtering=True,id=e1757463-6986-4a9e-938a-9960bbe17cb9,network=Network(183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1757463-69') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG os_vif [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:06:fa,bridge_name='br-int',has_traffic_filtering=True,id=e1757463-6986-4a9e-938a-9960bbe17cb9,network=Network(183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1757463-69') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1757463-69, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:12 user nova-compute[71692]: INFO os_vif [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:06:fa,bridge_name='br-int',has_traffic_filtering=True,id=e1757463-6986-4a9e-938a-9960bbe17cb9,network=Network(183bbbaf-b0ad-40fb-8fe1-9cf27ec03cf7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1757463-69')
Apr 13 18:59:12 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Deleting instance files /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0_del
Apr 13 18:59:12 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Deletion of /opt/stack/data/nova/instances/0ed13b57-30a9-44c2-a18d-f936d33209b0_del complete
Apr 13 18:59:12 user nova-compute[71692]: INFO nova.compute.manager [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 13 18:59:12 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:59:12 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:59:13 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:59:13 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Took 1.17 seconds to deallocate network for instance.
Apr 13 18:59:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:14 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:59:14 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:59:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-134b25d5-1797-41da-a0ad-c238e1c1b7fa req-88994a79-f147-4e3b-bf0a-2a0a845a32a0 service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Received event network-vif-plugged-e1757463-6986-4a9e-938a-9960bbe17cb9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-134b25d5-1797-41da-a0ad-c238e1c1b7fa req-88994a79-f147-4e3b-bf0a-2a0a845a32a0 service nova] Acquiring lock "0ed13b57-30a9-44c2-a18d-f936d33209b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-134b25d5-1797-41da-a0ad-c238e1c1b7fa req-88994a79-f147-4e3b-bf0a-2a0a845a32a0 service nova] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-134b25d5-1797-41da-a0ad-c238e1c1b7fa req-88994a79-f147-4e3b-bf0a-2a0a845a32a0 service nova] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-134b25d5-1797-41da-a0ad-c238e1c1b7fa req-88994a79-f147-4e3b-bf0a-2a0a845a32a0 service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] No waiting events found dispatching network-vif-plugged-e1757463-6986-4a9e-938a-9960bbe17cb9 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:59:14 user nova-compute[71692]: WARNING nova.compute.manager [req-134b25d5-1797-41da-a0ad-c238e1c1b7fa req-88994a79-f147-4e3b-bf0a-2a0a845a32a0 service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Received unexpected event network-vif-plugged-e1757463-6986-4a9e-938a-9960bbe17cb9 for instance with vm_state deleted and task_state None.
Apr 13 18:59:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-134b25d5-1797-41da-a0ad-c238e1c1b7fa req-88994a79-f147-4e3b-bf0a-2a0a845a32a0 service nova] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Received event network-vif-deleted-e1757463-6986-4a9e-938a-9960bbe17cb9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:14 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Deleted allocations for instance 0ed13b57-30a9-44c2-a18d-f936d33209b0
Apr 13 18:59:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-480f9b0a-0ab4-448d-9d1b-b3024704d9ae tempest-AttachSCSIVolumeTestJSON-655554039 tempest-AttachSCSIVolumeTestJSON-655554039-project-member] Lock "0ed13b57-30a9-44c2-a18d-f936d33209b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.520s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCSETRdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '570101b9-9c60-4c05-94ab-437a8a07d453', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef58d148-d663-41c3-bfdd-6e769782a5f3', 'serial': 'ef58d148-d663-41c3-bfdd-6e769782a5f3'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJLROzpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '570101b9-9c60-4c05-94ab-437a8a07d453', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a', 'serial'} {{(pid=71692) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCSETRdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:59:15 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:15 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:15 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[236acabe-3dab-4c7b-90bf-14aae109cc4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:59:15 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7564220-3c38-4e5c-a36d-466ff9893c09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3] added
Apr 13 18:59:15 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f484fb3-6494-489e-be6b-36f8308f3474]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a1e965-ddd6-41a4-a1b4-8345d91c6d26]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qCSETRdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qCSETRdc" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e4dd5a-1c06-4565-9b32-d95aa81811ef]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qCSETRdc'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bc48a0-68df-4e06-82fd-f44dca5eb823]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a43923e-a19c-4ab3-913e-234ffde3f417]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)
Apr 13 18:59:15 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)
Apr 13 18:59:15 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d679be3d-6b88-4ab2-afb1-f533340b6472]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3, portal: 172.16.0.220,3260]
Apr 13 18:59:15 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3, portal: 172.16.0.220,3260] successful.
Apr 13 18:59:15 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0f3c05-5cea-4180-965c-21ba20ce9b00]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9ddce1-2a7f-4f7b-ad1a-1b99a6eb3a84]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)
Apr 13 18:59:15 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:15 user nova-compute[71692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)
Apr 13 18:59:15 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] HCTL ('38', '-', '-', 0) found on session 10 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd36b8e-c791-465c-b43e-177f57543114]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Searching for a device in session 10 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:59:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCSETRdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:59:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23865653261336433', 'path': '/dev/sdg'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:59:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865653261336433', 'path': '/dev/sdg'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:59:17 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lazy-loading 'flavor' on Instance uuid 570101b9-9c60-4c05-94ab-437a8a07d453 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:59:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:59:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] COPY block job progress, current cursor: 155189248 final cursor: 1073741824 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:59:18 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] COPY block job progress, current cursor: 210763776 final cursor: 1073741824 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:59:18 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] COPY block job progress, current cursor: 359661568 final cursor: 1073741824 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:59:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] COPY block job progress, current cursor: 556793856 final cursor: 1073741824 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:59:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] COPY block job progress, current cursor: 747634688 final cursor: 1073741824 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:59:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] COPY block job progress, current cursor: 916455424 final cursor: 1073741824 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:59:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJLROzpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:59:21 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[79347902-9e09-461f-9c91-b82f66a31e9a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:59:21 user nova-compute[71692]: No targets found.
Apr 13 18:59:21 user nova-compute[71692]: iSNS:
Apr 13 18:59:21 user nova-compute[71692]: No targets found.
Apr 13 18:59:21 user nova-compute[71692]: STATIC:
Apr 13 18:59:21 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8
Apr 13 18:59:21 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:21 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:21 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65
Apr 13 18:59:21 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:21 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:21 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02
Apr 13 18:59:21 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:21 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:21 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a
Apr 13 18:59:21 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:21 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:21 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3
Apr 13 18:59:21 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:21 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:21 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a
Apr 13 18:59:21 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:21 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:21 user nova-compute[71692]: FIRMWARE:
Apr 13 18:59:21 user nova-compute[71692]: No targets found.
Apr 13 18:59:21 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:59:21 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:59:21 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b8fa15-d0aa-493c-a0fd-1a84389c14c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb483d0-21ac-48e2-b08b-4d3674f5580d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 (non-flash)
Apr 13 18:59:21 user nova-compute[71692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:21 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:21 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:21 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:21 user nova-compute[71692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)
Apr 13 18:59:21 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 (non-flash)
Apr 13 18:59:21 user nova-compute[71692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:21 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:21 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:21 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:21 user nova-compute[71692]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)
Apr 13 18:59:21 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc293d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a'): ({'sde'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Removing single pathed devices sde {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f60521-0f9e-49f4-934b-2bd9a66347a8]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d453ca-976f-49e1-bdd8-d87af5eea7be]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Flushing IO for device /dev/sde {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c50fbb0-389e-4d27-9e59-65bc6d48fa55]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7260f1bc-1496-4263-91e0-1d8afe78a99f]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] SCSI volumes sde have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a434ce-8d17-4b1d-82c6-3faff932e326]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf4f384-786d-4ca1-909c-139952e4de6d]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a, portal: 172.16.0.220,3260]
Apr 13 18:59:21 user nova-compute[71692]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a, portal: 172.16.0.220,3260] successful.
Apr 13 18:59:21 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c27203e-e2bf-4feb-a911-adeac73f4bad]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] <== disconnect_volume: return (291ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCSETRdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '570101b9-9c60-4c05-94ab-437a8a07d453', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef58d148-d663-41c3-bfdd-6e769782a5f3', 'serial'} {{(pid=71692) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 13 18:59:21 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] swap_volume: removing Cinder connection for volume ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a {{(pid=71692) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 13 18:59:22 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] swap_volume: Updating volume ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "qCSETRdc", "auth_password": "PGe4NBzRAmbYS3", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "ef58d148-d663-41c3-bfdd-6e769782a5f3"}, "status": "reserved", "instance": "570101b9-9c60-4c05-94ab-437a8a07d453", "attached_at": "", "detached_at": "", "volume_id": "ef58d148-d663-41c3-bfdd-6e769782a5f3", "serial": "ef58d148-d663-41c3-bfdd-6e769782a5f3"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ef58d148-d663-41c3-bfdd-6e769782a5f3', 'no_device': None, 'attachment_id': '8d2fa8a4-3e30-4226-abf9-0d96e9e80e88'} {{(pid=71692) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 13 18:59:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e780dd76-3c7c-4df9-9d43-69bf8e1b1e7b tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "570101b9-9c60-4c05-94ab-437a8a07d453" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.313s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Acquiring lock "570101b9-9c60-4c05-94ab-437a8a07d453" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "570101b9-9c60-4c05-94ab-437a8a07d453" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG os_brick.utils [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b481ac-ea9e-4dd2-9c03-0d510fbb42b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76d1e38-5930-4506-9e2d-5c63e2279581]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc41acb6-96ea-4a94-8e25-ed30cb2b1ca8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7a4b68-d39e-4c3e-b65f-f3c91e790526]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 18:59:23 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 18:59:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea665e02-3e72-4ab6-b507-6bcd67e574a9]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 18:59:23 user nova-compute[71692]: DEBUG os_brick.utils [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:59:23 user nova-compute[71692]: INFO nova.compute.manager [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Swapping volume ef58d148-d663-41c3-bfdd-6e769782a5f3 for ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a
Apr 13 18:59:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412352.670578, 0ed13b57-30a9-44c2-a18d-f936d33209b0 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:59:27 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] VM Stopped (Lifecycle Event)
Apr 13 18:59:27 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e224bcee-9082-4f32-9ce0-5936ae2e358e None None] [instance: 0ed13b57-30a9-44c2-a18d-f936d33209b0] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG nova.compute.manager [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJLROzpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '570101b9-9c60-4c05-94ab-437a8a07d453', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a', 'serial': 'ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCSETRdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'ef58d148-d663-41c3-bfdd-6e769782a5f3'}, 'status': 'reserved', 'instance': '570101b9-9c60-4c05-94ab-437a8a07d453', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef58d148-d663-41c3-bfdd-6e769782a5f3', 'serial'} {{(pid=71692) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJLROzpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:59:27 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:27 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:27 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc93511-213d-42d6-9ac9-78a615d7b3ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 18:59:27 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9017e7-2773-48cf-a98e-1c07468b5594]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a] added
Apr 13 18:59:27 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd01b61-90f9-47e5-bf59-8b887b434ca6]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[835eb836-8bf8-4314-acc2-a6ac08808652]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UJLROzpo {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UJLROzpo" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[459d7d8f-03e8-4121-8b4b-85db2b1e602f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UJLROzpo'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e42ba3e-2fe2-4e72-b870-927d8fb2b4df]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[032ff46d-0582-46f4-accd-30177c21e77f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 (non-flash)
Apr 13 18:59:27 user nova-compute[71692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:27 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:27 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:27 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:27 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 (non-flash)
Apr 13 18:59:27 user nova-compute[71692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:27 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:27 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:27 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:27 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c577a8fb-295d-4c6f-b92d-fa4f09784dc0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a, portal: 172.16.0.220,3260]
Apr 13 18:59:28 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a, portal: 172.16.0.220,3260] successful.
Apr 13 18:59:28 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a281df8-203b-403c-985b-fd9ebad554eb]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbf2df7-ca7c-4ce1-a6cb-1ab17b65f2d4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 (non-flash)
Apr 13 18:59:28 user nova-compute[71692]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)
Apr 13 18:59:28 user nova-compute[71692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:28 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:28 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:28 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:28 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 (non-flash)
Apr 13 18:59:28 user nova-compute[71692]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)
Apr 13 18:59:28 user nova-compute[71692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:28 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:28 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:28 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:28 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea4a11d-bd4b-4a82-98df-aa117d9ac8ad]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJLROzpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:59:28 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 18:59:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23061633363653030', 'path': '/dev/sde'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:59:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061633363653030', 'path': '/dev/sde'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 18:59:29 user nova-compute[71692]: DEBUG nova.objects.instance [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lazy-loading 'flavor' on Instance uuid 570101b9-9c60-4c05-94ab-437a8a07d453 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:59:29 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:59:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] COPY block job progress, current cursor: 171966464 final cursor: 1073741824 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] COPY block job progress, current cursor: 286261248 final cursor: 1073741824 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:30 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 18:59:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] COPY block job progress, current cursor: 464519168 final cursor: 1073741824 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:59:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] COPY block job progress, current cursor: 585105408 final cursor: 1073741824 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:59:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:32 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] COPY block job progress, current cursor: 764411904 final cursor: 1073741824 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:59:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:32 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] COPY block job progress, current cursor: 921698304 final cursor: 1073741824 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:59:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 18:59:33 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:59:33 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:59:33 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8168MB free_disk=26.370460510253906GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCSETRdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'ef58d148-d663-41c3-bfdd-6e769782a5f3': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:59:33 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance a15c1b5e-1769-490a-b81f-09333cd4a227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance f17525a6-e377-4b33-85cd-88a7aaf4569a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 106da0b9-c823-4f26-874c-53f8ad235e61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 570101b9-9c60-4c05-94ab-437a8a07d453 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance c655dda4-2db1-4f7c-8591-bb0512122583 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[298170d4-8bc1-491d-9001-b87e27a7348d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:59:33 user nova-compute[71692]: No targets found.
Apr 13 18:59:33 user nova-compute[71692]: iSNS:
Apr 13 18:59:33 user nova-compute[71692]: No targets found.
Apr 13 18:59:33 user nova-compute[71692]: STATIC:
Apr 13 18:59:33 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8
Apr 13 18:59:33 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:33 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:33 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65
Apr 13 18:59:33 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:33 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:33 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02
Apr 13 18:59:33 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:33 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:33 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a
Apr 13 18:59:33 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:33 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:33 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3
Apr 13 18:59:33 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:33 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:33 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a
Apr 13 18:59:33 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:33 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:33 user nova-compute[71692]: FIRMWARE:
Apr 13 18:59:33 user nova-compute[71692]: No targets found.
Apr 13 18:59:33 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:59:33 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:59:33 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6644f5-7562-4874-914e-681603991254]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e06314-4608-4c78-a53a-79abbfa0d2dc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 (non-flash)
Apr 13 18:59:33 user nova-compute[71692]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)
Apr 13 18:59:33 user nova-compute[71692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:33 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:33 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:33 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:33 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 (non-flash)
Apr 13 18:59:33 user nova-compute[71692]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)
Apr 13 18:59:33 user nova-compute[71692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:33 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:33 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:33 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:33 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc3a1bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3'): ({'sdg'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Removing single pathed devices sdg {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd6b933-25a9-41bf-a3ae-e9f7323b2dfa]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d135a57-4df9-4bfc-a66e-7aaee5e86cca]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Flushing IO for device /dev/sdg {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8e874a-952a-4ec3-a9be-269939d47921]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0985b173-c9d9-4d13-8c37-d5f6a24b82c9]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] SCSI volumes sdg have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0dea2f-4266-4331-8c0a-c60474d5ed2c]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0d1abe-f1e7-416e-b14b-98670662b9f1]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3, portal: 172.16.0.220,3260]
Apr 13 18:59:33 user nova-compute[71692]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3, portal: 172.16.0.220,3260] successful.
Apr 13 18:59:33 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 18:59:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef58d148-d663-41c3-bfdd-6e769782a5f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69fc6a9-05a4-4e88-9cf7-1d96f4f37163]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] <== disconnect_volume: return (361ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:59:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:59:34 user nova-compute[71692]: DEBUG nova.compute.manager [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJLROzpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '570101b9-9c60-4c05-94ab-437a8a07d453', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a', 'serial'} {{(pid=71692) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 13 18:59:34 user nova-compute[71692]: DEBUG nova.compute.manager [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] swap_volume: removing Cinder connection for volume ef58d148-d663-41c3-bfdd-6e769782a5f3 {{(pid=71692) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 13 18:59:34 user nova-compute[71692]: DEBUG nova.compute.manager [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] swap_volume: Updating volume ef58d148-d663-41c3-bfdd-6e769782a5f3 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "UJLROzpo", "auth_password": "A3dG5UD6gmzTCL", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a"}, "status": "reserved", "instance": "570101b9-9c60-4c05-94ab-437a8a07d453", "attached_at": "", "detached_at": "", "volume_id": "ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a", "serial": "ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a', 'no_device': None, 'attachment_id': '85d769ff-3168-4374-aaf8-b8e6d1e95d6f'} {{(pid=71692) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 13 18:59:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9b7a2764-5986-49ab-8b2a-5ac12b18414c tempest-TestVolumeSwap-1626359270 tempest-TestVolumeSwap-1626359270-project-admin] Lock "570101b9-9c60-4c05-94ab-437a8a07d453" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.798s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "570101b9-9c60-4c05-94ab-437a8a07d453" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "570101b9-9c60-4c05-94ab-437a8a07d453" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:35 user nova-compute[71692]: INFO nova.compute.manager [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Detaching volume ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a
Apr 13 18:59:35 user nova-compute[71692]: INFO nova.virt.block_device [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Attempting to driver detach volume ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a from mountpoint /dev/vdb
Apr 13 18:59:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Attempting to detach device vdb from instance 570101b9-9c60-4c05-94ab-437a8a07d453 from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 18:59:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:59:35 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:59:35 user nova-compute[71692]:   <source dev="/dev/sde"/>
Apr 13 18:59:35 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:59:35 user nova-compute[71692]:   <serial>ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a</serial>
Apr 13 18:59:35 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:59:35 user nova-compute[71692]: </disk>
Apr 13 18:59:35 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:59:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Successfully detached device vdb from instance 570101b9-9c60-4c05-94ab-437a8a07d453 from the persistent domain config.
Apr 13 18:59:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 570101b9-9c60-4c05-94ab-437a8a07d453 from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 18:59:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 18:59:35 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 18:59:35 user nova-compute[71692]:   <source dev="/dev/sde"/>
Apr 13 18:59:35 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 18:59:35 user nova-compute[71692]:   <serial>ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a</serial>
Apr 13 18:59:35 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 18:59:35 user nova-compute[71692]: </disk>
Apr 13 18:59:35 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 18:59:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:35 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:59:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-f17525a6-e377-4b33-85cd-88a7aaf4569a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-f17525a6-e377-4b33-85cd-88a7aaf4569a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681412376.2072601, 570101b9-9c60-4c05-94ab-437a8a07d453 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 570101b9-9c60-4c05-94ab-437a8a07d453 {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 18:59:36 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Successfully detached device vdb from instance 570101b9-9c60-4c05-94ab-437a8a07d453 from the live domain config.
Apr 13 18:59:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJLROzpo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:59:36 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f376c2c-bf27-4d23-b2a7-37766cfea438]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:59:36 user nova-compute[71692]: No targets found.
Apr 13 18:59:36 user nova-compute[71692]: iSNS:
Apr 13 18:59:36 user nova-compute[71692]: No targets found.
Apr 13 18:59:36 user nova-compute[71692]: STATIC:
Apr 13 18:59:36 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8
Apr 13 18:59:36 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:36 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:36 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65
Apr 13 18:59:36 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:36 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:36 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02
Apr 13 18:59:36 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:36 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:36 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a
Apr 13 18:59:36 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:36 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:36 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a
Apr 13 18:59:36 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:36 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:36 user nova-compute[71692]: FIRMWARE:
Apr 13 18:59:36 user nova-compute[71692]: No targets found.
Apr 13 18:59:36 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:59:36 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:59:36 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5c164a-400c-46e7-ac3b-97c37e5bdd9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[51587973-b79d-4711-ba7e-f5960ea49e07]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)
Apr 13 18:59:36 user nova-compute[71692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:36 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:36 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:36 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:36 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a (non-flash)
Apr 13 18:59:36 user nova-compute[71692]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:36 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:36 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:36 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:36 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc2d3370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a'): ({'sde'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Removing single pathed devices sde {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff810377-f195-4f43-8b60-4e0113d06bd7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42fe0c8-62f1-4265-827e-ec04b65a84b6]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Flushing IO for device /dev/sde {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e124f985-b603-4dff-9492-6fa64459a140]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c27ff36-7f4e-41ed-ac7d-a0fd216a0c33]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] SCSI volumes sde have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15ef6af-0e69-4e10-9eb4-4304d9b085db]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc2253d-82db-44da-89b9-d2b11815b257]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a, portal: 172.16.0.220,3260]
Apr 13 18:59:36 user nova-compute[71692]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a, portal: 172.16.0.220,3260] successful.
Apr 13 18:59:36 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee0abd5c-e0a7-4a2f-b024-ea73b6034a9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[879c7f88-02cd-4889-9fd7-9f3b78a676c4]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] <== disconnect_volume: return (329ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Updating instance_info_cache with network_info: [{"id": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "address": "fa:16:3e:01:cf:b5", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209c6974-cf", "ovs_interfaceid": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-f17525a6-e377-4b33-85cd-88a7aaf4569a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:59:36 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 18:59:37 user nova-compute[71692]: DEBUG nova.objects.instance [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lazy-loading 'flavor' on Instance uuid 570101b9-9c60-4c05-94ab-437a8a07d453 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:59:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3434ad55-df17-4c88-83df-11bd721afbf7 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "570101b9-9c60-4c05-94ab-437a8a07d453" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.715s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-91f9570f-00fd-452d-bf20-1acd405ce9cb req-86369408-24ee-4efb-8a9f-4345bd62a0e2 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-changed-e45634b1-0f7f-4888-ae83-8567da56407d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-91f9570f-00fd-452d-bf20-1acd405ce9cb req-86369408-24ee-4efb-8a9f-4345bd62a0e2 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Refreshing instance network info cache due to event network-changed-e45634b1-0f7f-4888-ae83-8567da56407d. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:59:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-91f9570f-00fd-452d-bf20-1acd405ce9cb req-86369408-24ee-4efb-8a9f-4345bd62a0e2 service nova] Acquiring lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:59:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-91f9570f-00fd-452d-bf20-1acd405ce9cb req-86369408-24ee-4efb-8a9f-4345bd62a0e2 service nova] Acquired lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:59:39 user nova-compute[71692]: DEBUG nova.network.neutron [req-91f9570f-00fd-452d-bf20-1acd405ce9cb req-86369408-24ee-4efb-8a9f-4345bd62a0e2 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Refreshing network info cache for port e45634b1-0f7f-4888-ae83-8567da56407d {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:59:40 user nova-compute[71692]: DEBUG nova.network.neutron [req-91f9570f-00fd-452d-bf20-1acd405ce9cb req-86369408-24ee-4efb-8a9f-4345bd62a0e2 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Updated VIF entry in instance network info cache for port e45634b1-0f7f-4888-ae83-8567da56407d. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 18:59:40 user nova-compute[71692]: DEBUG nova.network.neutron [req-91f9570f-00fd-452d-bf20-1acd405ce9cb req-86369408-24ee-4efb-8a9f-4345bd62a0e2 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Updating instance_info_cache with network_info: [{"id": "e45634b1-0f7f-4888-ae83-8567da56407d", "address": "fa:16:3e:b4:c4:a8", "network": {"id": "70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-97878308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45634b1-0f", "ovs_interfaceid": "e45634b1-0f7f-4888-ae83-8567da56407d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7512b86a-c124-4ae8-907e-8490d9444e87", "address": "fa:16:3e:19:a9:5d", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7512b86a-c1", "ovs_interfaceid": "7512b86a-c124-4ae8-907e-8490d9444e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "address": "fa:16:3e:38:22:da", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624b1877-60", "ovs_interfaceid": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "278cf193-9dcb-4703-b7d3-d3568a793952", "address": "fa:16:3e:38:e8:29", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278cf193-9d", "ovs_interfaceid": "278cf193-9dcb-4703-b7d3-d3568a793952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0411f083-60b0-41d4-af75-a509ace59ad5", "address": "fa:16:3e:62:0c:34", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0411f083-60", "ovs_interfaceid": "0411f083-60b0-41d4-af75-a509ace59ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "address": "fa:16:3e:f8:52:0d", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f025dce-fc", "ovs_interfaceid": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50b51917-5a26-4a85-878a-7d21023a7fb1", "address": "fa:16:3e:5e:58:be", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b51917-5a", "ovs_interfaceid": "50b51917-5a26-4a85-878a-7d21023a7fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:59:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-91f9570f-00fd-452d-bf20-1acd405ce9cb req-86369408-24ee-4efb-8a9f-4345bd62a0e2 service nova] Releasing lock "refresh_cache-c655dda4-2db1-4f7c-8591-bb0512122583" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:59:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "c655dda4-2db1-4f7c-8591-bb0512122583" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:41 user nova-compute[71692]: INFO nova.compute.manager [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Terminating instance
Apr 13 18:59:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-024d4e02-4db5-48a2-ac75-4e9982ddffc2 req-f3d426ea-b746-4661-8512-699c751113f1 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-unplugged-e45634b1-0f7f-4888-ae83-8567da56407d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-024d4e02-4db5-48a2-ac75-4e9982ddffc2 req-f3d426ea-b746-4661-8512-699c751113f1 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-024d4e02-4db5-48a2-ac75-4e9982ddffc2 req-f3d426ea-b746-4661-8512-699c751113f1 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-024d4e02-4db5-48a2-ac75-4e9982ddffc2 req-f3d426ea-b746-4661-8512-699c751113f1 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-024d4e02-4db5-48a2-ac75-4e9982ddffc2 req-f3d426ea-b746-4661-8512-699c751113f1 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-unplugged-e45634b1-0f7f-4888-ae83-8567da56407d {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-024d4e02-4db5-48a2-ac75-4e9982ddffc2 req-f3d426ea-b746-4661-8512-699c751113f1 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-unplugged-e45634b1-0f7f-4888-ae83-8567da56407d for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-7113a723-567c-4ad5-9104-6d921ccee072 req-cd557565-c19f-4e40-a116-8a6a515ec022 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-unplugged-624b1877-60ef-44ae-b9fa-c07cacb7fb72 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7113a723-567c-4ad5-9104-6d921ccee072 req-cd557565-c19f-4e40-a116-8a6a515ec022 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7113a723-567c-4ad5-9104-6d921ccee072 req-cd557565-c19f-4e40-a116-8a6a515ec022 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7113a723-567c-4ad5-9104-6d921ccee072 req-cd557565-c19f-4e40-a116-8a6a515ec022 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-7113a723-567c-4ad5-9104-6d921ccee072 req-cd557565-c19f-4e40-a116-8a6a515ec022 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-unplugged-624b1877-60ef-44ae-b9fa-c07cacb7fb72 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-7113a723-567c-4ad5-9104-6d921ccee072 req-cd557565-c19f-4e40-a116-8a6a515ec022 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-unplugged-624b1877-60ef-44ae-b9fa-c07cacb7fb72 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-be2a240f-caf3-4e36-a581-ba90dcaaaa85 req-ce59baf0-8174-4b69-9ce8-b440e9a74c78 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-unplugged-0411f083-60b0-41d4-af75-a509ace59ad5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-be2a240f-caf3-4e36-a581-ba90dcaaaa85 req-ce59baf0-8174-4b69-9ce8-b440e9a74c78 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-be2a240f-caf3-4e36-a581-ba90dcaaaa85 req-ce59baf0-8174-4b69-9ce8-b440e9a74c78 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-be2a240f-caf3-4e36-a581-ba90dcaaaa85 req-ce59baf0-8174-4b69-9ce8-b440e9a74c78 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-be2a240f-caf3-4e36-a581-ba90dcaaaa85 req-ce59baf0-8174-4b69-9ce8-b440e9a74c78 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-unplugged-0411f083-60b0-41d4-af75-a509ace59ad5 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-be2a240f-caf3-4e36-a581-ba90dcaaaa85 req-ce59baf0-8174-4b69-9ce8-b440e9a74c78 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-unplugged-0411f083-60b0-41d4-af75-a509ace59ad5 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:59:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Instance destroyed successfully.
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.objects.instance [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lazy-loading 'resources' on Instance uuid c655dda4-2db1-4f7c-8591-bb0512122583 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:58:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:58:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e45634b1-0f7f-4888-ae83-8567da56407d", "address": "fa:16:3e:b4:c4:a8", "network": {"id": "70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-97878308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45634b1-0f", "ovs_interfaceid": "e45634b1-0f7f-4888-ae83-8567da56407d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "e45634b1-0f7f-4888-ae83-8567da56407d", "address": "fa:16:3e:b4:c4:a8", "network": {"id": "70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-97878308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45634b1-0f", "ovs_interfaceid": "e45634b1-0f7f-4888-ae83-8567da56407d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:c4:a8,bridge_name='br-int',has_traffic_filtering=True,id=e45634b1-0f7f-4888-ae83-8567da56407d,network=Network(70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape45634b1-0f') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG os_vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:c4:a8,bridge_name='br-int',has_traffic_filtering=True,id=e45634b1-0f7f-4888-ae83-8567da56407d,network=Network(70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape45634b1-0f') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape45634b1-0f, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: INFO os_vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:c4:a8,bridge_name='br-int',has_traffic_filtering=True,id=e45634b1-0f7f-4888-ae83-8567da56407d,network=Network(70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape45634b1-0f')
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:58:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:58:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7512b86a-c124-4ae8-907e-8490d9444e87", "address": "fa:16:3e:19:a9:5d", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7512b86a-c1", "ovs_interfaceid": "7512b86a-c124-4ae8-907e-8490d9444e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "7512b86a-c124-4ae8-907e-8490d9444e87", "address": "fa:16:3e:19:a9:5d", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7512b86a-c1", "ovs_interfaceid": "7512b86a-c124-4ae8-907e-8490d9444e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:a9:5d,bridge_name='br-int',has_traffic_filtering=True,id=7512b86a-c124-4ae8-907e-8490d9444e87,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7512b86a-c1') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG os_vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:a9:5d,bridge_name='br-int',has_traffic_filtering=True,id=7512b86a-c124-4ae8-907e-8490d9444e87,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7512b86a-c1') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7512b86a-c1, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: INFO os_vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:a9:5d,bridge_name='br-int',has_traffic_filtering=True,id=7512b86a-c124-4ae8-907e-8490d9444e87,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7512b86a-c1')
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:58:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:58:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "address": "fa:16:3e:38:22:da", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624b1877-60", "ovs_interfaceid": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "address": "fa:16:3e:38:22:da", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624b1877-60", "ovs_interfaceid": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:22:da,bridge_name='br-int',has_traffic_filtering=True,id=624b1877-60ef-44ae-b9fa-c07cacb7fb72,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap624b1877-60') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG os_vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:22:da,bridge_name='br-int',has_traffic_filtering=True,id=624b1877-60ef-44ae-b9fa-c07cacb7fb72,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap624b1877-60') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap624b1877-60, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: INFO os_vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:22:da,bridge_name='br-int',has_traffic_filtering=True,id=624b1877-60ef-44ae-b9fa-c07cacb7fb72,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap624b1877-60')
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:58:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:58:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "278cf193-9dcb-4703-b7d3-d3568a793952", "address": "fa:16:3e:38:e8:29", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278cf193-9d", "ovs_interfaceid": "278cf193-9dcb-4703-b7d3-d3568a793952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "278cf193-9dcb-4703-b7d3-d3568a793952", "address": "fa:16:3e:38:e8:29", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278cf193-9d", "ovs_interfaceid": "278cf193-9dcb-4703-b7d3-d3568a793952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:e8:29,bridge_name='br-int',has_traffic_filtering=True,id=278cf193-9dcb-4703-b7d3-d3568a793952,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278cf193-9d') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG os_vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:e8:29,bridge_name='br-int',has_traffic_filtering=True,id=278cf193-9dcb-4703-b7d3-d3568a793952,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278cf193-9d') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap278cf193-9d, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: INFO os_vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:e8:29,bridge_name='br-int',has_traffic_filtering=True,id=278cf193-9dcb-4703-b7d3-d3568a793952,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap278cf193-9d')
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:58:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:58:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0411f083-60b0-41d4-af75-a509ace59ad5", "address": "fa:16:3e:62:0c:34", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0411f083-60", "ovs_interfaceid": "0411f083-60b0-41d4-af75-a509ace59ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "0411f083-60b0-41d4-af75-a509ace59ad5", "address": "fa:16:3e:62:0c:34", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0411f083-60", "ovs_interfaceid": "0411f083-60b0-41d4-af75-a509ace59ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:0c:34,bridge_name='br-int',has_traffic_filtering=True,id=0411f083-60b0-41d4-af75-a509ace59ad5,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0411f083-60') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG os_vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:0c:34,bridge_name='br-int',has_traffic_filtering=True,id=0411f083-60b0-41d4-af75-a509ace59ad5,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0411f083-60') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0411f083-60, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: INFO os_vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:0c:34,bridge_name='br-int',has_traffic_filtering=True,id=0411f083-60b0-41d4-af75-a509ace59ad5,network=Network(7e0f4926-cf1e-4cf9-b456-315821272683),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0411f083-60')
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:58:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:58:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "address": "fa:16:3e:f8:52:0d", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f025dce-fc", "ovs_interfaceid": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "address": "fa:16:3e:f8:52:0d", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f025dce-fc", "ovs_interfaceid": "8f025dce-fc38-4414-8e60-c924fd38d5dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:52:0d,bridge_name='br-int',has_traffic_filtering=True,id=8f025dce-fc38-4414-8e60-c924fd38d5dd,network=Network(5e734b04-2d73-42af-b120-2063ab3d7c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f025dce-fc') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG os_vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:52:0d,bridge_name='br-int',has_traffic_filtering=True,id=8f025dce-fc38-4414-8e60-c924fd38d5dd,network=Network(5e734b04-2d73-42af-b120-2063ab3d7c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f025dce-fc') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f025dce-fc, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:43 user nova-compute[71692]: INFO os_vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:52:0d,bridge_name='br-int',has_traffic_filtering=True,id=8f025dce-fc38-4414-8e60-c924fd38d5dd,network=Network(5e734b04-2d73-42af-b120-2063ab3d7c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f025dce-fc')
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T18:57:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1372126936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1372126936',id=9,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHujLwnMSjG5+6TGxoV6zqsuRe3MY7RneK2Yy+nijbMe0VT6z1j5paHUmIcjB9bamKImE0y+HAWootVBaTbCcM+PMvh1Fdc5SLZ0Z3FxgSGP9WeVVUmS4R7SeucsGHYg6Q==',key_name='tempest-keypair-2123184713',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:58:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e7c45edf2a84f86b4c91c12edb8c66a',ramdisk_id='',reservation_id='r-osn59knd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-573903665',owner_user_name='tempest-TaggedBootDevicesTest_v242-573903665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:58:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f63a7e8a5a374e66b26f2309874c5adb',uuid=c655dda4-2db1-4f7c-8591-bb0512122583,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50b51917-5a26-4a85-878a-7d21023a7fb1", "address": "fa:16:3e:5e:58:be", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b51917-5a", "ovs_interfaceid": "50b51917-5a26-4a85-878a-7d21023a7fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converting VIF {"id": "50b51917-5a26-4a85-878a-7d21023a7fb1", "address": "fa:16:3e:5e:58:be", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b51917-5a", "ovs_interfaceid": "50b51917-5a26-4a85-878a-7d21023a7fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:58:be,bridge_name='br-int',has_traffic_filtering=True,id=50b51917-5a26-4a85-878a-7d21023a7fb1,network=Network(5e734b04-2d73-42af-b120-2063ab3d7c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b51917-5a') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:58:be,bridge_name='br-int',has_traffic_filtering=True,id=50b51917-5a26-4a85-878a-7d21023a7fb1,network=Network(5e734b04-2d73-42af-b120-2063ab3d7c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b51917-5a') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50b51917-5a, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:43 user nova-compute[71692]: INFO os_vif [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:58:be,bridge_name='br-int',has_traffic_filtering=True,id=50b51917-5a26-4a85-878a-7d21023a7fb1,network=Network(5e734b04-2d73-42af-b120-2063ab3d7c85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b51917-5a')
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JCPAznqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:59:43 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c540fb4-4315-43ef-b5c6-cfdd2b9b3383]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:59:43 user nova-compute[71692]: No targets found.
Apr 13 18:59:43 user nova-compute[71692]: iSNS:
Apr 13 18:59:43 user nova-compute[71692]: No targets found.
Apr 13 18:59:43 user nova-compute[71692]: STATIC:
Apr 13 18:59:43 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8
Apr 13 18:59:43 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:43 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:43 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65
Apr 13 18:59:43 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:43 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:43 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02
Apr 13 18:59:43 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:43 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:43 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a
Apr 13 18:59:43 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:43 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:43 user nova-compute[71692]: FIRMWARE:
Apr 13 18:59:43 user nova-compute[71692]: No targets found.
Apr 13 18:59:43 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:59:43 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:59:43 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dd4012-99ed-421b-82e6-fe23d7189909]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[035dcc8f-60df-4f52-b50c-4946d238e1ba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:43 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:43 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:43 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:43 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 (non-flash)
Apr 13 18:59:43 user nova-compute[71692]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:43 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:43 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:43 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc2d0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8'): ({'sdb'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Removing single pathed devices sdb {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[be255b5f-00d0-4f4e-bddf-c131cbb9eb65]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a3e28d-d17d-479e-9ff4-2a1037cac89a]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Flushing IO for device /dev/sdb {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c94f44-ec69-4272-9253-8dffb0b9e72d]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[303fcd8e-6163-4d49-af83-8c9a96329ec6]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d0852a-4ab9-4ae1-a1dc-b2018b8ba856]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[291d2725-97cb-4cd0-859b-8ff4014921ee]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8, portal: 172.16.0.220,3260]
Apr 13 18:59:43 user nova-compute[71692]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8, portal: 172.16.0.220,3260] successful.
Apr 13 18:59:43 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82b16cf4-0675-493a-ae28-0f0138b4a6a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f563b5-b56b-4145-b5ee-7605b48fb054]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] <== disconnect_volume: return (303ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqMZmkJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:59:43 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-e45634b1-0f7f-4888-ae83-8567da56407d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-e45634b1-0f7f-4888-ae83-8567da56407d {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:59:43 user nova-compute[71692]: WARNING nova.compute.manager [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-e45634b1-0f7f-4888-ae83-8567da56407d for instance with vm_state active and task_state deleting.
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-unplugged-7512b86a-c124-4ae8-907e-8490d9444e87 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-unplugged-7512b86a-c124-4ae8-907e-8490d9444e87 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-unplugged-7512b86a-c124-4ae8-907e-8490d9444e87 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-7512b86a-c124-4ae8-907e-8490d9444e87 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-7512b86a-c124-4ae8-907e-8490d9444e87 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:59:43 user nova-compute[71692]: WARNING nova.compute.manager [req-7e75ef75-bf94-43c7-a16c-caf14c66f16b req-e72da59f-8c8f-4e14-bbb0-e568a655a62d service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-7512b86a-c124-4ae8-907e-8490d9444e87 for instance with vm_state active and task_state deleting.
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41bb3c3-1111-4d7c-9cfb-67d160329a0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:59:43 user nova-compute[71692]: No targets found.
Apr 13 18:59:43 user nova-compute[71692]: iSNS:
Apr 13 18:59:43 user nova-compute[71692]: No targets found.
Apr 13 18:59:43 user nova-compute[71692]: STATIC:
Apr 13 18:59:43 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65
Apr 13 18:59:43 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:43 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:43 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02
Apr 13 18:59:43 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:43 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:43 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a
Apr 13 18:59:43 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:43 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:43 user nova-compute[71692]: FIRMWARE:
Apr 13 18:59:43 user nova-compute[71692]: No targets found.
Apr 13 18:59:43 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:59:43 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:59:43 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fe3030-cc37-4497-ab18-14765c778c0e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f9ac82-cdaf-45ca-aa5c-063de4a14902]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:43 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:43 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:43 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 (non-flash)
Apr 13 18:59:43 user nova-compute[71692]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:43 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:43 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc3a3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65'): ({'sdc'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Removing single pathed devices sdc {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3bb69a-6a73-4361-994d-13346d3305e9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bebc598-b7d6-4809-a78a-39c9c86d0ef6]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Flushing IO for device /dev/sdc {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff0e5a0-c10d-4f12-a541-0d324ded3763]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.028s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8231757-46f7-4920-ab8c-7cef69747dea]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f47fc08-edbc-47f2-bad7-2bd31fa34a5d]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-624b1877-60ef-44ae-b9fa-c07cacb7fb72 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-624b1877-60ef-44ae-b9fa-c07cacb7fb72 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:59:43 user nova-compute[71692]: WARNING nova.compute.manager [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-624b1877-60ef-44ae-b9fa-c07cacb7fb72 for instance with vm_state active and task_state deleting.
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-unplugged-278cf193-9dcb-4703-b7d3-d3568a793952 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-unplugged-278cf193-9dcb-4703-b7d3-d3568a793952 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-unplugged-278cf193-9dcb-4703-b7d3-d3568a793952 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-278cf193-9dcb-4703-b7d3-d3568a793952 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-278cf193-9dcb-4703-b7d3-d3568a793952 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:59:43 user nova-compute[71692]: WARNING nova.compute.manager [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-278cf193-9dcb-4703-b7d3-d3568a793952 for instance with vm_state active and task_state deleting.
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-unplugged-50b51917-5a26-4a85-878a-7d21023a7fb1 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-unplugged-50b51917-5a26-4a85-878a-7d21023a7fb1 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-unplugged-50b51917-5a26-4a85-878a-7d21023a7fb1 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-50b51917-5a26-4a85-878a-7d21023a7fb1 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-50b51917-5a26-4a85-878a-7d21023a7fb1 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:59:43 user nova-compute[71692]: WARNING nova.compute.manager [req-56e995db-956e-48b3-a854-e3635efdbd78 req-d807891d-c31b-45a3-9ad4-cf74172b63b5 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-50b51917-5a26-4a85-878a-7d21023a7fb1 for instance with vm_state active and task_state deleting.
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7af6a13-7030-4ad3-8e74-872bceb15642]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65, portal: 172.16.0.220,3260]
Apr 13 18:59:43 user nova-compute[71692]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65, portal: 172.16.0.220,3260] successful.
Apr 13 18:59:43 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77537746-09dc-4379-b7d5-e17995736c65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d1289d-d8b9-4300-b17a-dc971e5434c8]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] <== disconnect_volume: return (293ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADdhnvWL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 18:59:43 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7263808b-2dce-45ad-b0a6-364650c9a694]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 18:59:43 user nova-compute[71692]: No targets found.
Apr 13 18:59:43 user nova-compute[71692]: iSNS:
Apr 13 18:59:43 user nova-compute[71692]: No targets found.
Apr 13 18:59:43 user nova-compute[71692]: STATIC:
Apr 13 18:59:43 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02
Apr 13 18:59:43 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:43 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:43 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a
Apr 13 18:59:43 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 18:59:43 user nova-compute[71692]:                 Iface Name: default
Apr 13 18:59:43 user nova-compute[71692]: FIRMWARE:
Apr 13 18:59:43 user nova-compute[71692]: No targets found.
Apr 13 18:59:43 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 18:59:43 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 18:59:43 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f6e7d4-5cac-45db-99fe-b34799a926ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e061994-6135-490a-bbfd-ea2ae13bf2b5]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:43 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:43 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a (non-flash)
Apr 13 18:59:43 user nova-compute[71692]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 18:59:43 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febd8bf4d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a'): ({'sdd'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Removing single pathed devices sdd {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[343df02d-01c4-448e-a590-da156720acb5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b45b09-8aa0-4869-a1e8-c52a23a783bb]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Flushing IO for device /dev/sdd {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6e59e4-6684-4566-a3e5-3373d25c290f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[776eb92a-a2a2-4655-bf29-e129a0551b19]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde0d9f2-ce6f-4199-afda-6afec165fa52]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-0411f083-60b0-41d4-af75-a509ace59ad5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-0411f083-60b0-41d4-af75-a509ace59ad5 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:59:43 user nova-compute[71692]: WARNING nova.compute.manager [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-0411f083-60b0-41d4-af75-a509ace59ad5 for instance with vm_state active and task_state deleting.
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-unplugged-8f025dce-fc38-4414-8e60-c924fd38d5dd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-unplugged-8f025dce-fc38-4414-8e60-c924fd38d5dd {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-unplugged-8f025dce-fc38-4414-8e60-c924fd38d5dd for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-plugged-8f025dce-fc38-4414-8e60-c924fd38d5dd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] Acquiring lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] Lock "c655dda4-2db1-4f7c-8591-bb0512122583-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] No waiting events found dispatching network-vif-plugged-8f025dce-fc38-4414-8e60-c924fd38d5dd {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 18:59:43 user nova-compute[71692]: WARNING nova.compute.manager [req-1061418d-f780-4408-ae1a-80f86922dd43 req-5fefc551-4462-41fc-bc7d-64d22270e7d8 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received unexpected event network-vif-plugged-8f025dce-fc38-4414-8e60-c924fd38d5dd for instance with vm_state active and task_state deleting.
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f23a8a-5084-4e3c-8954-0a2175390b72]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a, portal: 172.16.0.220,3260]
Apr 13 18:59:43 user nova-compute[71692]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a, portal: 172.16.0.220,3260] successful.
Apr 13 18:59:43 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75a05b92-4932-42a8-bd0b-ba98b157827a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce78d14-044d-44aa-b4d8-dc35b1a7d36c]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] <== disconnect_volume: return (295ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 18:59:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 18:59:43 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Deleting instance files /opt/stack/data/nova/instances/c655dda4-2db1-4f7c-8591-bb0512122583_del
Apr 13 18:59:43 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Deletion of /opt/stack/data/nova/instances/c655dda4-2db1-4f7c-8591-bb0512122583_del complete
Apr 13 18:59:44 user nova-compute[71692]: INFO nova.compute.manager [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Took 3.01 seconds to destroy the instance on the hypervisor.
Apr 13 18:59:44 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 18:59:44 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 18:59:44 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 18:59:45 user nova-compute[71692]: DEBUG nova.compute.manager [req-ebf98629-53d6-4726-896c-f1dc87f5d8cb req-57bf4d69-47c0-4b79-b3db-8c2087aa4b5e service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-deleted-8f025dce-fc38-4414-8e60-c924fd38d5dd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:45 user nova-compute[71692]: INFO nova.compute.manager [req-ebf98629-53d6-4726-896c-f1dc87f5d8cb req-57bf4d69-47c0-4b79-b3db-8c2087aa4b5e service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Neutron deleted interface 8f025dce-fc38-4414-8e60-c924fd38d5dd; detaching it from the instance and deleting it from the info cache
Apr 13 18:59:45 user nova-compute[71692]: DEBUG nova.network.neutron [req-ebf98629-53d6-4726-896c-f1dc87f5d8cb req-57bf4d69-47c0-4b79-b3db-8c2087aa4b5e service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Updating instance_info_cache with network_info: [{"id": "e45634b1-0f7f-4888-ae83-8567da56407d", "address": "fa:16:3e:b4:c4:a8", "network": {"id": "70ddc5d2-6b0c-42d9-b1d9-ae844885fa0c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-97878308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape45634b1-0f", "ovs_interfaceid": "e45634b1-0f7f-4888-ae83-8567da56407d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7512b86a-c124-4ae8-907e-8490d9444e87", "address": "fa:16:3e:19:a9:5d", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7512b86a-c1", "ovs_interfaceid": "7512b86a-c124-4ae8-907e-8490d9444e87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "address": "fa:16:3e:38:22:da", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624b1877-60", "ovs_interfaceid": "624b1877-60ef-44ae-b9fa-c07cacb7fb72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "278cf193-9dcb-4703-b7d3-d3568a793952", "address": "fa:16:3e:38:e8:29", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap278cf193-9d", "ovs_interfaceid": "278cf193-9dcb-4703-b7d3-d3568a793952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0411f083-60b0-41d4-af75-a509ace59ad5", "address": "fa:16:3e:62:0c:34", "network": {"id": "7e0f4926-cf1e-4cf9-b456-315821272683", "bridge": "br-int", "label": "tempest-device-tagging-net1-201773914", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0411f083-60", "ovs_interfaceid": "0411f083-60b0-41d4-af75-a509ace59ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "50b51917-5a26-4a85-878a-7d21023a7fb1", "address": "fa:16:3e:5e:58:be", "network": {"id": "5e734b04-2d73-42af-b120-2063ab3d7c85", "bridge": "br-int", "label": "tempest-device-tagging-net2-1480559619", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e7c45edf2a84f86b4c91c12edb8c66a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b51917-5a", "ovs_interfaceid": "50b51917-5a26-4a85-878a-7d21023a7fb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:59:45 user nova-compute[71692]: DEBUG nova.compute.manager [req-ebf98629-53d6-4726-896c-f1dc87f5d8cb req-57bf4d69-47c0-4b79-b3db-8c2087aa4b5e service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Detach interface failed, port_id=8f025dce-fc38-4414-8e60-c924fd38d5dd, reason: Instance c655dda4-2db1-4f7c-8591-bb0512122583 could not be found. {{(pid=71692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 18:59:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:47 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:59:47 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Took 3.60 seconds to deallocate network for instance.
Apr 13 18:59:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-c8f124eb-b9f3-47b2-ae04-2e035f0efa83 req-336ab277-101b-4e63-9c1b-cc5275330277 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-deleted-e45634b1-0f7f-4888-ae83-8567da56407d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-c8f124eb-b9f3-47b2-ae04-2e035f0efa83 req-336ab277-101b-4e63-9c1b-cc5275330277 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-deleted-50b51917-5a26-4a85-878a-7d21023a7fb1 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-c8f124eb-b9f3-47b2-ae04-2e035f0efa83 req-336ab277-101b-4e63-9c1b-cc5275330277 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-deleted-278cf193-9dcb-4703-b7d3-d3568a793952 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-c8f124eb-b9f3-47b2-ae04-2e035f0efa83 req-336ab277-101b-4e63-9c1b-cc5275330277 service nova] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Received event network-vif-deleted-0411f083-60b0-41d4-af75-a509ace59ad5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:49 user nova-compute[71692]: INFO nova.compute.manager [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Took 2.33 seconds to detach 3 volumes for instance.
Apr 13 18:59:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:50 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:59:50 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:59:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:50 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Deleted allocations for instance c655dda4-2db1-4f7c-8591-bb0512122583
Apr 13 18:59:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4c71c39e-d5c3-42cf-ac34-2c14dba9031a tempest-TaggedBootDevicesTest_v242-573903665 tempest-TaggedBootDevicesTest_v242-573903665-project-member] Lock "c655dda4-2db1-4f7c-8591-bb0512122583" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.386s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "81690e5b-0bcc-4e7c-87b6-e51a30571888" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "81690e5b-0bcc-4e7c-87b6-e51a30571888" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 18:59:57 user nova-compute[71692]: INFO nova.compute.claims [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Claim successful on node user
Apr 13 18:59:57 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412382.655827, c655dda4-2db1-4f7c-8591-bb0512122583 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 18:59:57 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] VM Stopped (Lifecycle Event)
Apr 13 18:59:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-76e8df31-4a36-4fd9-9e0c-7d4319acbdd5 None None] [instance: c655dda4-2db1-4f7c-8591-bb0512122583] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 18:59:57 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 18:59:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG nova.policy [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3e1ffe2f879f4c049b6c28d3a9623d14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d708f05aa7c454bbf94931b6b5593bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 18:59:57 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Creating image(s)
Apr 13 18:59:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "/opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "/opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "/opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.130s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk 1073741824" returned: 0 in 0.046s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Successfully created port: 97015895-15bd-401e-aa52-776f82605bc4 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Cannot resize image /opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lazy-loading 'migration_context' on Instance uuid 81690e5b-0bcc-4e7c-87b6-e51a30571888 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Ensure instance console log exists: /opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 18:59:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Successfully updated port: 97015895-15bd-401e-aa52-776f82605bc4 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "refresh_cache-81690e5b-0bcc-4e7c-87b6-e51a30571888" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquired lock "refresh_cache-81690e5b-0bcc-4e7c-87b6-e51a30571888" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-e83cccdb-c2c3-4207-a4c3-680ea3ae7280 req-f362f230-a87c-4908-ad61-50b5cc88807e service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Received event network-changed-97015895-15bd-401e-aa52-776f82605bc4 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-e83cccdb-c2c3-4207-a4c3-680ea3ae7280 req-f362f230-a87c-4908-ad61-50b5cc88807e service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Refreshing instance network info cache due to event network-changed-97015895-15bd-401e-aa52-776f82605bc4. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e83cccdb-c2c3-4207-a4c3-680ea3ae7280 req-f362f230-a87c-4908-ad61-50b5cc88807e service nova] Acquiring lock "refresh_cache-81690e5b-0bcc-4e7c-87b6-e51a30571888" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Updating instance_info_cache with network_info: [{"id": "97015895-15bd-401e-aa52-776f82605bc4", "address": "fa:16:3e:88:19:31", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97015895-15", "ovs_interfaceid": "97015895-15bd-401e-aa52-776f82605bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Releasing lock "refresh_cache-81690e5b-0bcc-4e7c-87b6-e51a30571888" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Instance network_info: |[{"id": "97015895-15bd-401e-aa52-776f82605bc4", "address": "fa:16:3e:88:19:31", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97015895-15", "ovs_interfaceid": "97015895-15bd-401e-aa52-776f82605bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e83cccdb-c2c3-4207-a4c3-680ea3ae7280 req-f362f230-a87c-4908-ad61-50b5cc88807e service nova] Acquired lock "refresh_cache-81690e5b-0bcc-4e7c-87b6-e51a30571888" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.network.neutron [req-e83cccdb-c2c3-4207-a4c3-680ea3ae7280 req-f362f230-a87c-4908-ad61-50b5cc88807e service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Refreshing network info cache for port 97015895-15bd-401e-aa52-776f82605bc4 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Start _get_guest_xml network_info=[{"id": "97015895-15bd-401e-aa52-776f82605bc4", "address": "fa:16:3e:88:19:31", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97015895-15", "ovs_interfaceid": "97015895-15bd-401e-aa52-776f82605bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 18:59:59 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:59:59 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2091050597',display_name='tempest-VolumesAdminNegativeTest-server-2091050597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2091050597',id=11,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d708f05aa7c454bbf94931b6b5593bf',ramdisk_id='',reservation_id='r-0bgvf9j1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-947401316',owner_user_name='tempest-VolumesAdminNegativeTest-947401316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:59:58Z,user_data=None,user_id='3e1ffe2f879f4c049b6c28d3a9623d14',uuid=81690e5b-0bcc-4e7c-87b6-e51a30571888,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97015895-15bd-401e-aa52-776f82605bc4", "address": "fa:16:3e:88:19:31", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97015895-15", "ovs_interfaceid": "97015895-15bd-401e-aa52-776f82605bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 18:59:59 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Converting VIF {"id": "97015895-15bd-401e-aa52-776f82605bc4", "address": "fa:16:3e:88:19:31", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97015895-15", "ovs_interfaceid": "97015895-15bd-401e-aa52-776f82605bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:19:31,bridge_name='br-int',has_traffic_filtering=True,id=97015895-15bd-401e-aa52-776f82605bc4,network=Network(99569b6e-2d6c-4e03-9971-462e962f316f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97015895-15') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lazy-loading 'pci_devices' on Instance uuid 81690e5b-0bcc-4e7c-87b6-e51a30571888 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:00:00 user nova-compute[71692]:   <uuid>81690e5b-0bcc-4e7c-87b6-e51a30571888</uuid>
Apr 13 19:00:00 user nova-compute[71692]:   <name>instance-0000000b</name>
Apr 13 19:00:00 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:00:00 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:00:00 user nova-compute[71692]:   <metadata>
Apr 13 19:00:00 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:00:00 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:00:00 user nova-compute[71692]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2091050597</nova:name>
Apr 13 19:00:00 user nova-compute[71692]:       <nova:creationTime>2023-04-13 18:59:59</nova:creationTime>
Apr 13 19:00:00 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:00:00 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:00:00 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:00:00 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:00:00 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:00:00 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:00:00 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:00:00 user nova-compute[71692]:       <nova:owner>
Apr 13 19:00:00 user nova-compute[71692]:         <nova:user uuid="3e1ffe2f879f4c049b6c28d3a9623d14">tempest-VolumesAdminNegativeTest-947401316-project-member</nova:user>
Apr 13 19:00:00 user nova-compute[71692]:         <nova:project uuid="0d708f05aa7c454bbf94931b6b5593bf">tempest-VolumesAdminNegativeTest-947401316</nova:project>
Apr 13 19:00:00 user nova-compute[71692]:       </nova:owner>
Apr 13 19:00:00 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:00:00 user nova-compute[71692]:       <nova:ports>
Apr 13 19:00:00 user nova-compute[71692]:         <nova:port uuid="97015895-15bd-401e-aa52-776f82605bc4">
Apr 13 19:00:00 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 19:00:00 user nova-compute[71692]:         </nova:port>
Apr 13 19:00:00 user nova-compute[71692]:       </nova:ports>
Apr 13 19:00:00 user nova-compute[71692]:     </nova:instance>
Apr 13 19:00:00 user nova-compute[71692]:   </metadata>
Apr 13 19:00:00 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:00:00 user nova-compute[71692]:     <system>
Apr 13 19:00:00 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:00:00 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:00:00 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:00:00 user nova-compute[71692]:       <entry name="serial">81690e5b-0bcc-4e7c-87b6-e51a30571888</entry>
Apr 13 19:00:00 user nova-compute[71692]:       <entry name="uuid">81690e5b-0bcc-4e7c-87b6-e51a30571888</entry>
Apr 13 19:00:00 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:00:00 user nova-compute[71692]:     </system>
Apr 13 19:00:00 user nova-compute[71692]:   </sysinfo>
Apr 13 19:00:00 user nova-compute[71692]:   <os>
Apr 13 19:00:00 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:00:00 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:00:00 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:00:00 user nova-compute[71692]:   </os>
Apr 13 19:00:00 user nova-compute[71692]:   <features>
Apr 13 19:00:00 user nova-compute[71692]:     <acpi/>
Apr 13 19:00:00 user nova-compute[71692]:     <apic/>
Apr 13 19:00:00 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:00:00 user nova-compute[71692]:   </features>
Apr 13 19:00:00 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:00:00 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:00:00 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:00:00 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:00:00 user nova-compute[71692]:   </clock>
Apr 13 19:00:00 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:00:00 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:00:00 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:00:00 user nova-compute[71692]:   </cpu>
Apr 13 19:00:00 user nova-compute[71692]:   <devices>
Apr 13 19:00:00 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:00:00 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:00:00 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk"/>
Apr 13 19:00:00 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:00:00 user nova-compute[71692]:     </disk>
Apr 13 19:00:00 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:00:00 user nova-compute[71692]:       <mac address="fa:16:3e:88:19:31"/>
Apr 13 19:00:00 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:00:00 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:00:00 user nova-compute[71692]:       <target dev="tap97015895-15"/>
Apr 13 19:00:00 user nova-compute[71692]:     </interface>
Apr 13 19:00:00 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:00:00 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/console.log" append="off"/>
Apr 13 19:00:00 user nova-compute[71692]:     </serial>
Apr 13 19:00:00 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:00:00 user nova-compute[71692]:     <video>
Apr 13 19:00:00 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:00:00 user nova-compute[71692]:     </video>
Apr 13 19:00:00 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:00:00 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:00:00 user nova-compute[71692]:     </rng>
Apr 13 19:00:00 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:00:00 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:00:00 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:00:00 user nova-compute[71692]:     </memballoon>
Apr 13 19:00:00 user nova-compute[71692]:   </devices>
Apr 13 19:00:00 user nova-compute[71692]: </domain>
Apr 13 19:00:00 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2091050597',display_name='tempest-VolumesAdminNegativeTest-server-2091050597',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2091050597',id=11,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d708f05aa7c454bbf94931b6b5593bf',ramdisk_id='',reservation_id='r-0bgvf9j1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-947401316',owner_user_name='tempest-VolumesAdminNegativeTest-947401316-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:59:58Z,user_data=None,user_id='3e1ffe2f879f4c049b6c28d3a9623d14',uuid=81690e5b-0bcc-4e7c-87b6-e51a30571888,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97015895-15bd-401e-aa52-776f82605bc4", "address": "fa:16:3e:88:19:31", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97015895-15", "ovs_interfaceid": "97015895-15bd-401e-aa52-776f82605bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Converting VIF {"id": "97015895-15bd-401e-aa52-776f82605bc4", "address": "fa:16:3e:88:19:31", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97015895-15", "ovs_interfaceid": "97015895-15bd-401e-aa52-776f82605bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:19:31,bridge_name='br-int',has_traffic_filtering=True,id=97015895-15bd-401e-aa52-776f82605bc4,network=Network(99569b6e-2d6c-4e03-9971-462e962f316f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97015895-15') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG os_vif [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:19:31,bridge_name='br-int',has_traffic_filtering=True,id=97015895-15bd-401e-aa52-776f82605bc4,network=Network(99569b6e-2d6c-4e03-9971-462e962f316f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97015895-15') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97015895-15, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap97015895-15, col_values=(('external_ids', {'iface-id': '97015895-15bd-401e-aa52-776f82605bc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:19:31', 'vm-uuid': '81690e5b-0bcc-4e7c-87b6-e51a30571888'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:00 user nova-compute[71692]: INFO os_vif [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:19:31,bridge_name='br-int',has_traffic_filtering=True,id=97015895-15bd-401e-aa52-776f82605bc4,network=Network(99569b6e-2d6c-4e03-9971-462e962f316f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97015895-15')
Apr 13 19:00:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] No VIF found with MAC fa:16:3e:88:19:31, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG nova.network.neutron [req-e83cccdb-c2c3-4207-a4c3-680ea3ae7280 req-f362f230-a87c-4908-ad61-50b5cc88807e service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Updated VIF entry in instance network info cache for port 97015895-15bd-401e-aa52-776f82605bc4. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG nova.network.neutron [req-e83cccdb-c2c3-4207-a4c3-680ea3ae7280 req-f362f230-a87c-4908-ad61-50b5cc88807e service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Updating instance_info_cache with network_info: [{"id": "97015895-15bd-401e-aa52-776f82605bc4", "address": "fa:16:3e:88:19:31", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97015895-15", "ovs_interfaceid": "97015895-15bd-401e-aa52-776f82605bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e83cccdb-c2c3-4207-a4c3-680ea3ae7280 req-f362f230-a87c-4908-ad61-50b5cc88807e service nova] Releasing lock "refresh_cache-81690e5b-0bcc-4e7c-87b6-e51a30571888" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:00:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-791081b3-715a-43c8-b49f-6c8eb0800525 req-d49f5c20-e36c-460e-b916-d673979fc2d3 service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Received event network-vif-plugged-97015895-15bd-401e-aa52-776f82605bc4 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:00:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-791081b3-715a-43c8-b49f-6c8eb0800525 req-d49f5c20-e36c-460e-b916-d673979fc2d3 service nova] Acquiring lock "81690e5b-0bcc-4e7c-87b6-e51a30571888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-791081b3-715a-43c8-b49f-6c8eb0800525 req-d49f5c20-e36c-460e-b916-d673979fc2d3 service nova] Lock "81690e5b-0bcc-4e7c-87b6-e51a30571888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-791081b3-715a-43c8-b49f-6c8eb0800525 req-d49f5c20-e36c-460e-b916-d673979fc2d3 service nova] Lock "81690e5b-0bcc-4e7c-87b6-e51a30571888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-791081b3-715a-43c8-b49f-6c8eb0800525 req-d49f5c20-e36c-460e-b916-d673979fc2d3 service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] No waiting events found dispatching network-vif-plugged-97015895-15bd-401e-aa52-776f82605bc4 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:00:01 user nova-compute[71692]: WARNING nova.compute.manager [req-791081b3-715a-43c8-b49f-6c8eb0800525 req-d49f5c20-e36c-460e-b916-d673979fc2d3 service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Received unexpected event network-vif-plugged-97015895-15bd-401e-aa52-776f82605bc4 for instance with vm_state building and task_state spawning.
Apr 13 19:00:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412403.5115056, 81690e5b-0bcc-4e7c-87b6-e51a30571888 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:00:03 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] VM Resumed (Lifecycle Event)
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:00:03 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Instance spawned successfully.
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:00:03 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412403.51351, 81690e5b-0bcc-4e7c-87b6-e51a30571888 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:00:03 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] VM Started (Lifecycle Event)
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:00:03 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:00:03 user nova-compute[71692]: INFO nova.compute.manager [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Took 5.69 seconds to spawn the instance on the hypervisor.
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.compute.manager [req-ab104923-5ec7-46a8-a0ce-d68702737921 req-d0faf8ed-33b3-4dd1-9d40-dc6041167e13 service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Received event network-vif-plugged-97015895-15bd-401e-aa52-776f82605bc4 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:00:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ab104923-5ec7-46a8-a0ce-d68702737921 req-d0faf8ed-33b3-4dd1-9d40-dc6041167e13 service nova] Acquiring lock "81690e5b-0bcc-4e7c-87b6-e51a30571888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ab104923-5ec7-46a8-a0ce-d68702737921 req-d0faf8ed-33b3-4dd1-9d40-dc6041167e13 service nova] Lock "81690e5b-0bcc-4e7c-87b6-e51a30571888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ab104923-5ec7-46a8-a0ce-d68702737921 req-d0faf8ed-33b3-4dd1-9d40-dc6041167e13 service nova] Lock "81690e5b-0bcc-4e7c-87b6-e51a30571888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:03 user nova-compute[71692]: DEBUG nova.compute.manager [req-ab104923-5ec7-46a8-a0ce-d68702737921 req-d0faf8ed-33b3-4dd1-9d40-dc6041167e13 service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] No waiting events found dispatching network-vif-plugged-97015895-15bd-401e-aa52-776f82605bc4 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:00:03 user nova-compute[71692]: WARNING nova.compute.manager [req-ab104923-5ec7-46a8-a0ce-d68702737921 req-d0faf8ed-33b3-4dd1-9d40-dc6041167e13 service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Received unexpected event network-vif-plugged-97015895-15bd-401e-aa52-776f82605bc4 for instance with vm_state building and task_state spawning.
Apr 13 19:00:03 user nova-compute[71692]: INFO nova.compute.manager [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Took 6.33 seconds to build instance.
Apr 13 19:00:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e9059c96-c137-4774-be24-8f33e546e883 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "81690e5b-0bcc-4e7c-87b6-e51a30571888" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.425s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:24 user nova-compute[71692]: INFO nova.compute.manager [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Terminating instance
Apr 13 19:00:24 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-e824de80-7ffb-47e0-a1bf-70d2c1ec6639 req-066bf4bb-a29b-42e2-8b8a-9e12cdd95908 service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Received event network-vif-unplugged-6d3713a2-ef39-4f8b-964a-e4bcd4082bea {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e824de80-7ffb-47e0-a1bf-70d2c1ec6639 req-066bf4bb-a29b-42e2-8b8a-9e12cdd95908 service nova] Acquiring lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e824de80-7ffb-47e0-a1bf-70d2c1ec6639 req-066bf4bb-a29b-42e2-8b8a-9e12cdd95908 service nova] Lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e824de80-7ffb-47e0-a1bf-70d2c1ec6639 req-066bf4bb-a29b-42e2-8b8a-9e12cdd95908 service nova] Lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-e824de80-7ffb-47e0-a1bf-70d2c1ec6639 req-066bf4bb-a29b-42e2-8b8a-9e12cdd95908 service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] No waiting events found dispatching network-vif-unplugged-6d3713a2-ef39-4f8b-964a-e4bcd4082bea {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-e824de80-7ffb-47e0-a1bf-70d2c1ec6639 req-066bf4bb-a29b-42e2-8b8a-9e12cdd95908 service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Received event network-vif-unplugged-6d3713a2-ef39-4f8b-964a-e4bcd4082bea for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:24 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Instance destroyed successfully.
Apr 13 19:00:24 user nova-compute[71692]: DEBUG nova.objects.instance [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lazy-loading 'resources' on Instance uuid 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:58:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-987915062',display_name='tempest-ServersNegativeTestJSON-server-987915062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-987915062',id=10,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:58:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1308cc4c5734de9a9fd83688c8da796',ramdisk_id='',reservation_id='r-435qc79j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1876599222',owner_user_name='tempest-ServersNegativeTestJSON-1876599222-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:58:41Z,user_data=None,user_id='3e7f76b4b7fb4651b3bce0e72f8a4de6',uuid=0d7ba594-cc5f-470e-9cd3-7ff90f341aeb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "address": "fa:16:3e:b2:43:e9", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3713a2-ef", "ovs_interfaceid": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Converting VIF {"id": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "address": "fa:16:3e:b2:43:e9", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d3713a2-ef", "ovs_interfaceid": "6d3713a2-ef39-4f8b-964a-e4bcd4082bea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:43:e9,bridge_name='br-int',has_traffic_filtering=True,id=6d3713a2-ef39-4f8b-964a-e4bcd4082bea,network=Network(ae895ef0-18d7-4f77-bcc6-bcb3dd22026f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3713a2-ef') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG os_vif [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:43:e9,bridge_name='br-int',has_traffic_filtering=True,id=6d3713a2-ef39-4f8b-964a-e4bcd4082bea,network=Network(ae895ef0-18d7-4f77-bcc6-bcb3dd22026f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3713a2-ef') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d3713a2-ef, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:24 user nova-compute[71692]: INFO os_vif [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:43:e9,bridge_name='br-int',has_traffic_filtering=True,id=6d3713a2-ef39-4f8b-964a-e4bcd4082bea,network=Network(ae895ef0-18d7-4f77-bcc6-bcb3dd22026f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d3713a2-ef')
Apr 13 19:00:24 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Deleting instance files /opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb_del
Apr 13 19:00:24 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Deletion of /opt/stack/data/nova/instances/0d7ba594-cc5f-470e-9cd3-7ff90f341aeb_del complete
Apr 13 19:00:24 user nova-compute[71692]: INFO nova.compute.manager [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 13 19:00:24 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:00:24 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:00:25 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:00:25 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Took 0.44 seconds to deallocate network for instance.
Apr 13 19:00:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:25 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:00:25 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:00:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:25 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Deleted allocations for instance 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb
Apr 13 19:00:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8593456f-3b79-4b8b-94df-b41afcbd4610 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.568s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "570101b9-9c60-4c05-94ab-437a8a07d453" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "570101b9-9c60-4c05-94ab-437a8a07d453" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "570101b9-9c60-4c05-94ab-437a8a07d453-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "570101b9-9c60-4c05-94ab-437a8a07d453-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "570101b9-9c60-4c05-94ab-437a8a07d453-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:25 user nova-compute[71692]: INFO nova.compute.manager [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Terminating instance
Apr 13 19:00:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG nova.compute.manager [req-6d4d8fc2-7892-46ba-b77e-4b21828750be req-f4173c4d-5a4d-4e56-b7e3-c490d041b8f4 service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Received event network-vif-unplugged-3e432daf-10a6-4797-b1f8-ad67a2b8417f {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6d4d8fc2-7892-46ba-b77e-4b21828750be req-f4173c4d-5a4d-4e56-b7e3-c490d041b8f4 service nova] Acquiring lock "570101b9-9c60-4c05-94ab-437a8a07d453-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6d4d8fc2-7892-46ba-b77e-4b21828750be req-f4173c4d-5a4d-4e56-b7e3-c490d041b8f4 service nova] Lock "570101b9-9c60-4c05-94ab-437a8a07d453-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6d4d8fc2-7892-46ba-b77e-4b21828750be req-f4173c4d-5a4d-4e56-b7e3-c490d041b8f4 service nova] Lock "570101b9-9c60-4c05-94ab-437a8a07d453-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG nova.compute.manager [req-6d4d8fc2-7892-46ba-b77e-4b21828750be req-f4173c4d-5a4d-4e56-b7e3-c490d041b8f4 service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] No waiting events found dispatching network-vif-unplugged-3e432daf-10a6-4797-b1f8-ad67a2b8417f {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG nova.compute.manager [req-6d4d8fc2-7892-46ba-b77e-4b21828750be req-f4173c4d-5a4d-4e56-b7e3-c490d041b8f4 service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Received event network-vif-unplugged-3e432daf-10a6-4797-b1f8-ad67a2b8417f for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG nova.compute.manager [req-9eea1400-237e-4c37-9df2-702ea71f7920 req-e9bc240f-f5b9-4d3f-ba06-dd18bc910b9d service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Received event network-vif-plugged-6d3713a2-ef39-4f8b-964a-e4bcd4082bea {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9eea1400-237e-4c37-9df2-702ea71f7920 req-e9bc240f-f5b9-4d3f-ba06-dd18bc910b9d service nova] Acquiring lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9eea1400-237e-4c37-9df2-702ea71f7920 req-e9bc240f-f5b9-4d3f-ba06-dd18bc910b9d service nova] Lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9eea1400-237e-4c37-9df2-702ea71f7920 req-e9bc240f-f5b9-4d3f-ba06-dd18bc910b9d service nova] Lock "0d7ba594-cc5f-470e-9cd3-7ff90f341aeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG nova.compute.manager [req-9eea1400-237e-4c37-9df2-702ea71f7920 req-e9bc240f-f5b9-4d3f-ba06-dd18bc910b9d service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] No waiting events found dispatching network-vif-plugged-6d3713a2-ef39-4f8b-964a-e4bcd4082bea {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:00:26 user nova-compute[71692]: WARNING nova.compute.manager [req-9eea1400-237e-4c37-9df2-702ea71f7920 req-e9bc240f-f5b9-4d3f-ba06-dd18bc910b9d service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Received unexpected event network-vif-plugged-6d3713a2-ef39-4f8b-964a-e4bcd4082bea for instance with vm_state deleted and task_state None.
Apr 13 19:00:26 user nova-compute[71692]: DEBUG nova.compute.manager [req-9eea1400-237e-4c37-9df2-702ea71f7920 req-e9bc240f-f5b9-4d3f-ba06-dd18bc910b9d service nova] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Received event network-vif-deleted-6d3713a2-ef39-4f8b-964a-e4bcd4082bea {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:00:26 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Instance destroyed successfully.
Apr 13 19:00:26 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lazy-loading 'resources' on Instance uuid 570101b9-9c60-4c05-94ab-437a8a07d453 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:57:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1559374833',display_name='tempest-TestVolumeSwap-server-1559374833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1559374833',id=8,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIHybbKbv7HB+poxM5bK6awPxAExJljIECejrWYDmeSfQmp6wCacJOP/VGUPmj5NG5bAbHqNGkaAPI2nHiqHCKbFPdHWi6SSD7AEztbj0Dk/6ervAhiyZ1/5WcBBSR/7Q==',key_name='tempest-keypair-1823176268',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc420cebeb8945cea96fe22173ad2b5b',ramdisk_id='',reservation_id='r-mj240e1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-65519151',owner_user_name='tempest-TestVolumeSwap-65519151-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:57:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ff89f9a33e348e69d8a7e986100d421',uuid=570101b9-9c60-4c05-94ab-437a8a07d453,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "address": "fa:16:3e:2f:62:f1", "network": {"id": "c63ad37e-6185-435b-bc54-f9a888e474bd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-679119519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc420cebeb8945cea96fe22173ad2b5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e432daf-10", "ovs_interfaceid": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Converting VIF {"id": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "address": "fa:16:3e:2f:62:f1", "network": {"id": "c63ad37e-6185-435b-bc54-f9a888e474bd", "bridge": "br-int", "label": "tempest-TestVolumeSwap-679119519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc420cebeb8945cea96fe22173ad2b5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e432daf-10", "ovs_interfaceid": "3e432daf-10a6-4797-b1f8-ad67a2b8417f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:62:f1,bridge_name='br-int',has_traffic_filtering=True,id=3e432daf-10a6-4797-b1f8-ad67a2b8417f,network=Network(c63ad37e-6185-435b-bc54-f9a888e474bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e432daf-10') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG os_vif [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:62:f1,bridge_name='br-int',has_traffic_filtering=True,id=3e432daf-10a6-4797-b1f8-ad67a2b8417f,network=Network(c63ad37e-6185-435b-bc54-f9a888e474bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e432daf-10') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e432daf-10, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:26 user nova-compute[71692]: INFO os_vif [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:62:f1,bridge_name='br-int',has_traffic_filtering=True,id=3e432daf-10a6-4797-b1f8-ad67a2b8417f,network=Network(c63ad37e-6185-435b-bc54-f9a888e474bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e432daf-10')
Apr 13 19:00:26 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Deleting instance files /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453_del
Apr 13 19:00:26 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Deletion of /opt/stack/data/nova/instances/570101b9-9c60-4c05-94ab-437a8a07d453_del complete
Apr 13 19:00:26 user nova-compute[71692]: INFO nova.compute.manager [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 13 19:00:26 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:00:26 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:00:27 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:00:27 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Took 0.70 seconds to deallocate network for instance.
Apr 13 19:00:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:27 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:00:27 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:00:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:27 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Deleted allocations for instance 570101b9-9c60-4c05-94ab-437a8a07d453
Apr 13 19:00:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ca79707d-3a1c-4fc0-9982-ff997cc6b075 tempest-TestVolumeSwap-65519151 tempest-TestVolumeSwap-65519151-project-member] Lock "570101b9-9c60-4c05-94ab-437a8a07d453" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.964s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG nova.objects.instance [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'flavor' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquired lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG nova.objects.instance [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'info_cache' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG nova.compute.manager [req-36b2c557-5b46-4f3d-a465-25c233410a4b req-1b34c4d3-46cc-40b2-9c92-49a47282fbaf service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Received event network-vif-plugged-3e432daf-10a6-4797-b1f8-ad67a2b8417f {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-36b2c557-5b46-4f3d-a465-25c233410a4b req-1b34c4d3-46cc-40b2-9c92-49a47282fbaf service nova] Acquiring lock "570101b9-9c60-4c05-94ab-437a8a07d453-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-36b2c557-5b46-4f3d-a465-25c233410a4b req-1b34c4d3-46cc-40b2-9c92-49a47282fbaf service nova] Lock "570101b9-9c60-4c05-94ab-437a8a07d453-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-36b2c557-5b46-4f3d-a465-25c233410a4b req-1b34c4d3-46cc-40b2-9c92-49a47282fbaf service nova] Lock "570101b9-9c60-4c05-94ab-437a8a07d453-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG nova.compute.manager [req-36b2c557-5b46-4f3d-a465-25c233410a4b req-1b34c4d3-46cc-40b2-9c92-49a47282fbaf service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] No waiting events found dispatching network-vif-plugged-3e432daf-10a6-4797-b1f8-ad67a2b8417f {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:00:28 user nova-compute[71692]: WARNING nova.compute.manager [req-36b2c557-5b46-4f3d-a465-25c233410a4b req-1b34c4d3-46cc-40b2-9c92-49a47282fbaf service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Received unexpected event network-vif-plugged-3e432daf-10a6-4797-b1f8-ad67a2b8417f for instance with vm_state deleted and task_state None.
Apr 13 19:00:28 user nova-compute[71692]: DEBUG nova.compute.manager [req-4a533b2f-772c-4ecc-8b32-02d9fa52e9d6 req-34e44a8b-0ad0-4455-95e9-a5acf53cbed3 service nova] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Received event network-vif-deleted-3e432daf-10a6-4797-b1f8-ad67a2b8417f {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Updating instance_info_cache with network_info: [{"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Releasing lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:00:28 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Instance destroyed successfully.
Apr 13 19:00:28 user nova-compute[71692]: DEBUG nova.objects.instance [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'resources' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-401678638',display_name='tempest-AttachVolumeTestJSON-server-401678638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-401678638',id=2,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE5B1S6SqZNLSYUvXCtLzlE03oQZAx0ezu9QmfHUm/VQFyAV9bhAsOFjrmYjBIjMOSTPvvajdVY1JHSqXEdUecpJFgE/NvFW0y7bhYdRssG3xIWyUJMMg1figOyi2kGeg==',key_name='tempest-keypair-1245494573',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:56:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='63b52d6508154a918a13b31712b32796',ramdisk_id='',reservation_id='r-ecb50eo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-43043273',owner_user_name='tempest-AttachVolumeTestJSON-43043273-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:58:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba70f34af8664dc89fd9851d00d5b96d',uuid=a15c1b5e-1769-490a-b81f-09333cd4a227,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converting VIF {"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG os_vif [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9907d23-58, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:28 user nova-compute[71692]: INFO os_vif [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58')
Apr 13 19:00:28 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmIMbCua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:00:28 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:00:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b70be9-0e6f-4dfa-8748-053a1dc0d050]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:00:28 user nova-compute[71692]: No targets found.
Apr 13 19:00:28 user nova-compute[71692]: iSNS:
Apr 13 19:00:28 user nova-compute[71692]: No targets found.
Apr 13 19:00:28 user nova-compute[71692]: STATIC:
Apr 13 19:00:28 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02
Apr 13 19:00:28 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:00:28 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:00:28 user nova-compute[71692]: FIRMWARE:
Apr 13 19:00:28 user nova-compute[71692]: No targets found.
Apr 13 19:00:28 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:00:28 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:00:28 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[26972166-0d20-4466-8a57-bd513aad685c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0266e53-6b27-4a52-a1a2-a644db22d632]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:28 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:28 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc3a0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02'): ({'sdf'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Removing single pathed devices sdf {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[49180dd8-a9d7-4131-b95e-fe6b9015acb9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7de146-8962-4705-b33d-c586447c3b17]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Flushing IO for device /dev/sdf {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c632a5fd-7c6c-48e4-bb23-63f83e43d6e1]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.036s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16afc8f-c81e-470f-bd13-f77102b359a7]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] SCSI volumes sdf have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89d9335-69a8-4563-8e43-70e626f35ed1]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ca50aa-9f93-4bde-85ef-d729f14b3e46]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02, portal: 172.16.0.220,3260]
Apr 13 19:00:29 user nova-compute[71692]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02, portal: 172.16.0.220,3260] successful.
Apr 13 19:00:29 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fe063b-b1e8-4ae8-9cdc-9d018ec70aef]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] <== disconnect_volume: return (267ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Start _get_guest_xml network_info=[{"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '0da983dd-4d05-4844-b06f-878436cfee17', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmIMbCua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'a15c1b5e-1769-490a-b81f-09333cd4a227', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0036a0d-e82a-4dee-b536-e4252af1ca02', 'serial': 'e0036a0d-e82a-4dee-b536-e4252af1ca02'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.objects.instance [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'numa_topology' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:29 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:00:29 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.objects.instance [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'vcpu_model' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmIMbCua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:00:29 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:00:29 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:00:29 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[41faf565-d004-4cac-8b2c-899a86a38875]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:00:29 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[787fcff8-d7fb-4655-89fc-1caf220b33a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02] added
Apr 13 19:00:29 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f722ee06-7b6a-4525-896f-92be7c1f3d2c]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b1bb7b-68ee-4cab-8239-84446542d3bf]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tmIMbCua {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tmIMbCua" returned: 0 in 0.033s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d57526-77ec-4c07-b936-dbd0149ce102]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tmIMbCua'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b2671e-bdae-42e0-bec0-4a2828c78596]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d92949-ccbb-409b-9dfe-a83d125cdc13]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 19:00:29 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 19:00:29 user nova-compute[71692]:  {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:00:29 user nova-compute[71692]: WARNING os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 19:00:29 user nova-compute[71692]: 
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa2055d-17b5-4ced-8922-6186f74f82d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02, portal: 172.16.0.220,3260]
Apr 13 19:00:29 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02, portal: 172.16.0.220,3260] successful.
Apr 13 19:00:29 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0391c0f8-e181-438a-92c5-953c8967a97d]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a257118-d52f-4449-a5b9-5fa78560a66c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:29 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:29 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0f10c2-f538-4804-9024-43d9dd445880]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:00:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmIMbCua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23632633536333739', 'path': '/dev/sdb'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632633536333739', 'path': '/dev/sdb'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-401678638',display_name='tempest-AttachVolumeTestJSON-server-401678638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-401678638',id=2,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE5B1S6SqZNLSYUvXCtLzlE03oQZAx0ezu9QmfHUm/VQFyAV9bhAsOFjrmYjBIjMOSTPvvajdVY1JHSqXEdUecpJFgE/NvFW0y7bhYdRssG3xIWyUJMMg1figOyi2kGeg==',key_name='tempest-keypair-1245494573',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:56:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='63b52d6508154a918a13b31712b32796',ramdisk_id='',reservation_id='r-ecb50eo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-43043273',owner_user_name='tempest-AttachVolumeTestJSON-43043273-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:58:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba70f34af8664dc89fd9851d00d5b96d',uuid=a15c1b5e-1769-490a-b81f-09333cd4a227,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converting VIF {"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG nova.objects.instance [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'pci_devices' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:00:30 user nova-compute[71692]:   <uuid>a15c1b5e-1769-490a-b81f-09333cd4a227</uuid>
Apr 13 19:00:30 user nova-compute[71692]:   <name>instance-00000002</name>
Apr 13 19:00:30 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:00:30 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:00:30 user nova-compute[71692]:   <metadata>
Apr 13 19:00:30 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:00:30 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:00:30 user nova-compute[71692]:       <nova:name>tempest-AttachVolumeTestJSON-server-401678638</nova:name>
Apr 13 19:00:30 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:00:29</nova:creationTime>
Apr 13 19:00:30 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:00:30 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:00:30 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:00:30 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:00:30 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:00:30 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:00:30 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:00:30 user nova-compute[71692]:       <nova:owner>
Apr 13 19:00:30 user nova-compute[71692]:         <nova:user uuid="ba70f34af8664dc89fd9851d00d5b96d">tempest-AttachVolumeTestJSON-43043273-project-member</nova:user>
Apr 13 19:00:30 user nova-compute[71692]:         <nova:project uuid="63b52d6508154a918a13b31712b32796">tempest-AttachVolumeTestJSON-43043273</nova:project>
Apr 13 19:00:30 user nova-compute[71692]:       </nova:owner>
Apr 13 19:00:30 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:00:30 user nova-compute[71692]:       <nova:ports>
Apr 13 19:00:30 user nova-compute[71692]:         <nova:port uuid="a9907d23-585e-46b6-935d-d2d1f7d840f2">
Apr 13 19:00:30 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 19:00:30 user nova-compute[71692]:         </nova:port>
Apr 13 19:00:30 user nova-compute[71692]:       </nova:ports>
Apr 13 19:00:30 user nova-compute[71692]:     </nova:instance>
Apr 13 19:00:30 user nova-compute[71692]:   </metadata>
Apr 13 19:00:30 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:00:30 user nova-compute[71692]:     <system>
Apr 13 19:00:30 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:00:30 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:00:30 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:00:30 user nova-compute[71692]:       <entry name="serial">a15c1b5e-1769-490a-b81f-09333cd4a227</entry>
Apr 13 19:00:30 user nova-compute[71692]:       <entry name="uuid">a15c1b5e-1769-490a-b81f-09333cd4a227</entry>
Apr 13 19:00:30 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:00:30 user nova-compute[71692]:     </system>
Apr 13 19:00:30 user nova-compute[71692]:   </sysinfo>
Apr 13 19:00:30 user nova-compute[71692]:   <os>
Apr 13 19:00:30 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:00:30 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:00:30 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:00:30 user nova-compute[71692]:   </os>
Apr 13 19:00:30 user nova-compute[71692]:   <features>
Apr 13 19:00:30 user nova-compute[71692]:     <acpi/>
Apr 13 19:00:30 user nova-compute[71692]:     <apic/>
Apr 13 19:00:30 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:00:30 user nova-compute[71692]:   </features>
Apr 13 19:00:30 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:00:30 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:00:30 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:00:30 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:00:30 user nova-compute[71692]:   </clock>
Apr 13 19:00:30 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:00:30 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:00:30 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:00:30 user nova-compute[71692]:   </cpu>
Apr 13 19:00:30 user nova-compute[71692]:   <devices>
Apr 13 19:00:30 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:00:30 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:00:30 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk"/>
Apr 13 19:00:30 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:00:30 user nova-compute[71692]:     </disk>
Apr 13 19:00:30 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:00:30 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:00:30 user nova-compute[71692]:       <source dev="/dev/sdb"/>
Apr 13 19:00:30 user nova-compute[71692]:       <target dev="vdb" bus="virtio"/>
Apr 13 19:00:30 user nova-compute[71692]:       <serial>e0036a0d-e82a-4dee-b536-e4252af1ca02</serial>
Apr 13 19:00:30 user nova-compute[71692]:     </disk>
Apr 13 19:00:30 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:00:30 user nova-compute[71692]:       <mac address="fa:16:3e:7b:3b:25"/>
Apr 13 19:00:30 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:00:30 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:00:30 user nova-compute[71692]:       <target dev="tapa9907d23-58"/>
Apr 13 19:00:30 user nova-compute[71692]:     </interface>
Apr 13 19:00:30 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:00:30 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/console.log" append="off"/>
Apr 13 19:00:30 user nova-compute[71692]:     </serial>
Apr 13 19:00:30 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:00:30 user nova-compute[71692]:     <video>
Apr 13 19:00:30 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:00:30 user nova-compute[71692]:     </video>
Apr 13 19:00:30 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:00:30 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:00:30 user nova-compute[71692]:     </rng>
Apr 13 19:00:30 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:00:30 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:00:30 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:00:30 user nova-compute[71692]:     </memballoon>
Apr 13 19:00:30 user nova-compute[71692]:   </devices>
Apr 13 19:00:30 user nova-compute[71692]: </domain>
Apr 13 19:00:30 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:30 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG nova.objects.instance [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'trusted_certs' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.147s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Cannot resize image /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG nova.objects.instance [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'migration_context' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-401678638',display_name='tempest-AttachVolumeTestJSON-server-401678638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-401678638',id=2,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE5B1S6SqZNLSYUvXCtLzlE03oQZAx0ezu9QmfHUm/VQFyAV9bhAsOFjrmYjBIjMOSTPvvajdVY1JHSqXEdUecpJFgE/NvFW0y7bhYdRssG3xIWyUJMMg1figOyi2kGeg==',key_name='tempest-keypair-1245494573',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:56:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='63b52d6508154a918a13b31712b32796',ramdisk_id='',reservation_id='r-ecb50eo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-43043273',owner_user_name='tempest-AttachVolumeTestJSON-43043273-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T18:58:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba70f34af8664dc89fd9851d00d5b96d',uuid=a15c1b5e-1769-490a-b81f-09333cd4a227,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converting VIF {"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG os_vif [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9907d23-58, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9907d23-58, col_values=(('external_ids', {'iface-id': 'a9907d23-585e-46b6-935d-d2d1f7d840f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:3b:25', 'vm-uuid': 'a15c1b5e-1769-490a-b81f-09333cd4a227'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:31 user nova-compute[71692]: INFO os_vif [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58')
Apr 13 19:00:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:32 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:00:32 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:00:32 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8379MB free_disk=26.39840316772461GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:00:32 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:32 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:32 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance a15c1b5e-1769-490a-b81f-09333cd4a227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:00:32 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance f17525a6-e377-4b33-85cd-88a7aaf4569a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:00:32 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:00:32 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 106da0b9-c823-4f26-874c-53f8ad235e61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:00:32 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 81690e5b-0bcc-4e7c-87b6-e51a30571888 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:00:32 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:00:32 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:00:32 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:00:32 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:00:32 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:00:32 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:33 user nova-compute[71692]: DEBUG nova.compute.manager [req-0d051b9a-e81b-475f-85c1-dcfbac7965dd req-229e544e-f8a3-40e8-b70f-d7d7d82bc425 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:00:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d051b9a-e81b-475f-85c1-dcfbac7965dd req-229e544e-f8a3-40e8-b70f-d7d7d82bc425 service nova] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d051b9a-e81b-475f-85c1-dcfbac7965dd req-229e544e-f8a3-40e8-b70f-d7d7d82bc425 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d051b9a-e81b-475f-85c1-dcfbac7965dd req-229e544e-f8a3-40e8-b70f-d7d7d82bc425 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:33 user nova-compute[71692]: DEBUG nova.compute.manager [req-0d051b9a-e81b-475f-85c1-dcfbac7965dd req-229e544e-f8a3-40e8-b70f-d7d7d82bc425 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] No waiting events found dispatching network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:00:33 user nova-compute[71692]: WARNING nova.compute.manager [req-0d051b9a-e81b-475f-85c1-dcfbac7965dd req-229e544e-f8a3-40e8-b70f-d7d7d82bc425 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received unexpected event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance with vm_state stopped and task_state powering-on.
Apr 13 19:00:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:33 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:00:33 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:00:33 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:00:33 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Skipping network cache update for instance because it has been migrated to another host. {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9836}}
Apr 13 19:00:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:00:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:00:33 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG nova.objects.instance [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'flavor' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:34 user nova-compute[71692]: INFO nova.compute.manager [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Attaching volume 09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 to /dev/vdb
Apr 13 19:00:34 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating instance_info_cache with network_info: [{"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG os_brick.utils [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5661d36d-06ea-40e2-bc45-9bf7a597eb56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[813cb0c1-059d-4fcd-a705-d63bc77d2d8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca32343-2a4b-4fb4-8b7b-1238267e13d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8878542e-25fc-406a-b414-aec9a40d63e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:00:34 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:00:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22521fb-5418-41a0-bde6-75f7f6947af2]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG os_brick.utils [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:00:34 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating existing volume attachment record: 8f3515e0-3c1c-4074-a2be-ceeb9ce4ed8a {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG nova.compute.manager [req-e4ad0287-8a94-4ac0-ab54-2a5dd87357c0 req-880dcd14-1203-4083-a4cb-1d84e3ebb1c6 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e4ad0287-8a94-4ac0-ab54-2a5dd87357c0 req-880dcd14-1203-4083-a4cb-1d84e3ebb1c6 service nova] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e4ad0287-8a94-4ac0-ab54-2a5dd87357c0 req-880dcd14-1203-4083-a4cb-1d84e3ebb1c6 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e4ad0287-8a94-4ac0-ab54-2a5dd87357c0 req-880dcd14-1203-4083-a4cb-1d84e3ebb1c6 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG nova.compute.manager [req-e4ad0287-8a94-4ac0-ab54-2a5dd87357c0 req-880dcd14-1203-4083-a4cb-1d84e3ebb1c6 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] No waiting events found dispatching network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:00:35 user nova-compute[71692]: WARNING nova.compute.manager [req-e4ad0287-8a94-4ac0-ab54-2a5dd87357c0 req-880dcd14-1203-4083-a4cb-1d84e3ebb1c6 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received unexpected event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance with vm_state stopped and task_state powering-on.
Apr 13 19:00:35 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412435.4999022, a15c1b5e-1769-490a-b81f-09333cd4a227 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:00:35 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] VM Resumed (Lifecycle Event)
Apr 13 19:00:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:00:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Instance rebooted successfully.
Apr 13 19:00:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-3baa9c61-8fb8-490c-854b-986d6f1c0aa9 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:35 user nova-compute[71692]: INFO nova.compute.manager [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Unshelving
Apr 13 19:00:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:00:35 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 13 19:00:35 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412435.5016258, a15c1b5e-1769-490a-b81f-09333cd4a227 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:00:35 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] VM Started (Lifecycle Event)
Apr 13 19:00:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:00:35 user nova-compute[71692]: INFO nova.virt.block_device [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Booting with volume 20b015e0-df81-41d5-a1fa-0e7666672a88 at /dev/vdc
Apr 13 19:00:35 user nova-compute[71692]: DEBUG os_brick.utils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2044926b-f408-450b-9701-3c836c20813b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e71a48-893f-4f92-86fd-373e9da3e645]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16e5a12-3dd5-4e98-8fc7-3fc04860255b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abb7110-5652-4b27-863b-01db935be1d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:00:35 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:00:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[16073ddd-0530-461b-87c9-99e9360cc00f]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG os_brick.utils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Updating existing volume attachment record: c18419f4-6e50-40c7-b591-fe0733046c08 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:00:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojTJyDmn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:00:39 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:00:39 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:00:39 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260" returned: 21 in 0.035s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d797ae08-ecc2-4611-a882-bf2f211e46e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:00:39 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[344de674-4843-40bd-8ca3-752ebbfdfee7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9] added
Apr 13 19:00:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1029fc31-9693-41f1-8599-4728f08215c9]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b732b199-3d17-48e2-9bb6-0397cf7f34ea]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ojTJyDmn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412424.7736983, 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:00:39 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] VM Stopped (Lifecycle Event)
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ojTJyDmn" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bda02b-3465-4bf3-a1e4-5ba9aaecb66b]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ojTJyDmn'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG nova.compute.manager [None req-10d459af-32c7-4dc4-b597-9a1ac91c873c None None] [instance: 0d7ba594-cc5f-470e-9cd3-7ff90f341aeb] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c247be2a-2b66-49a2-a0a8-0acc77772a3c]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a979a9ec-3b23-48a9-970b-955b55f02e0e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ddbe52-10af-4923-a27d-80b5b9d83c70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9, portal: 172.16.0.220,3260]
Apr 13 19:00:39 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9, portal: 172.16.0.220,3260] successful.
Apr 13 19:00:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e781b6-c15e-4554-9169-336ab5109288]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9835e6dc-8afd-466b-83a4-3473b65ebc38]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:39 user nova-compute[71692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)
Apr 13 19:00:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:39 user nova-compute[71692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)
Apr 13 19:00:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:40 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce64de2b-0168-4c59-88ef-a0818f621e87]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:40 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:00:40 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojTJyDmn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:00:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:40 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'pci_requests' on Instance uuid ca1b4132-15bd-4d4e-8d0c-d074824c888f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:40 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'numa_topology' on Instance uuid ca1b4132-15bd-4d4e-8d0c-d074824c888f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:40 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:00:40 user nova-compute[71692]: INFO nova.compute.claims [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Claim successful on node user
Apr 13 19:00:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23234613239623439', 'path': '/dev/sdc'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234613239623439', 'path': '/dev/sdc'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG nova.objects.instance [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'flavor' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:00:41 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:00:41 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:00:41 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:00:41 user nova-compute[71692]:   <serial>09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9</serial>
Apr 13 19:00:41 user nova-compute[71692]: </disk>
Apr 13 19:00:41 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:41 user nova-compute[71692]: INFO nova.network.neutron [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Updating port 5a439b7e-d075-4d9e-9673-523b5aa356fd with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No VIF found with MAC fa:16:3e:bc:71:09, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-01f482cd-35e2-4e51-a2d5-45efbe680cd0 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.266s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:41 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412426.747796, 570101b9-9c60-4c05-94ab-437a8a07d453 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:00:41 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] VM Stopped (Lifecycle Event)
Apr 13 19:00:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-846154d9-9c2d-4d24-8d5e-1d084ec93ea0 None None] [instance: 570101b9-9c60-4c05-94ab-437a8a07d453] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:00:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:00:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquired lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:00:42 user nova-compute[71692]: DEBUG nova.network.neutron [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:00:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-420b9ddf-c768-4ec3-b313-2eba3b3482bd req-8cff3e28-94a4-4cc5-88c5-16ca739cb98d service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received event network-changed-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:00:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-420b9ddf-c768-4ec3-b313-2eba3b3482bd req-8cff3e28-94a4-4cc5-88c5-16ca739cb98d service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Refreshing instance network info cache due to event network-changed-5a439b7e-d075-4d9e-9673-523b5aa356fd. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:00:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-420b9ddf-c768-4ec3-b313-2eba3b3482bd req-8cff3e28-94a4-4cc5-88c5-16ca739cb98d service nova] Acquiring lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:00:42 user nova-compute[71692]: INFO nova.compute.manager [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Rebuilding instance
Apr 13 19:00:42 user nova-compute[71692]: DEBUG nova.objects.instance [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'trusted_certs' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:42 user nova-compute[71692]: DEBUG nova.compute.manager [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG nova.objects.instance [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'pci_requests' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG nova.objects.instance [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'pci_devices' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG nova.objects.instance [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'resources' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG nova.objects.instance [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'migration_context' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG nova.objects.instance [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71692) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG nova.network.neutron [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Updating instance_info_cache with network_info: [{"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Releasing lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:00:43 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Creating image(s)
Apr 13 19:00:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "/opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "/opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'trusted_certs' on Instance uuid ca1b4132-15bd-4d4e-8d0c-d074824c888f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-420b9ddf-c768-4ec3-b313-2eba3b3482bd req-8cff3e28-94a4-4cc5-88c5-16ca739cb98d service nova] Acquired lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG nova.network.neutron [req-420b9ddf-c768-4ec3-b313-2eba3b3482bd req-8cff3e28-94a4-4cc5-88c5-16ca739cb98d service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Refreshing network info cache for port 5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "fc7af15914c05ded0f464543e0c8651dbfab425c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "fc7af15914c05ded0f464543e0c8651dbfab425c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.005s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c.part --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:44 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Instance destroyed successfully.
Apr 13 19:00:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c.part --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:44 user nova-compute[71692]: DEBUG nova.virt.images [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 7d0d0224-bc69-47f5-a6a5-c6f72a864595 was qcow2, converting to raw {{(pid=71692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 19:00:44 user nova-compute[71692]: DEBUG nova.privsep.utils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 19:00:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c.part /opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c.converted {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-unplugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:00:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] No waiting events found dispatching network-vif-unplugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:00:44 user nova-compute[71692]: WARNING nova.compute.manager [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received unexpected event network-vif-unplugged-2b297ca1-e672-438a-917a-df2319262bc0 for instance with vm_state active and task_state rebuilding.
Apr 13 19:00:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:00:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] No waiting events found dispatching network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:00:44 user nova-compute[71692]: WARNING nova.compute.manager [req-54082bf6-a695-4483-8ac8-d67b133517b8 req-0e0b1619-5145-4fc4-90e3-c3fd97841bb4 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received unexpected event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 for instance with vm_state active and task_state rebuilding.
Apr 13 19:00:44 user nova-compute[71692]: INFO nova.compute.manager [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Detaching volume 09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c.part /opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c.converted" returned: 0 in 0.256s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c.converted --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:45 user nova-compute[71692]: INFO nova.virt.block_device [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Attempting to driver detach volume 09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 from mountpoint /dev/vdb
Apr 13 19:00:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Attempting to detach device vdb from instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:00:45 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:00:45 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:00:45 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:00:45 user nova-compute[71692]:   <serial>09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9</serial>
Apr 13 19:00:45 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:00:45 user nova-compute[71692]: </disk>
Apr 13 19:00:45 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:00:45 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Successfully detached device vdb from instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 from the persistent domain config.
Apr 13 19:00:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojTJyDmn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:00:45 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f54c031-a0e5-4e17-b501-90662fa671c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:00:45 user nova-compute[71692]: No targets found.
Apr 13 19:00:45 user nova-compute[71692]: iSNS:
Apr 13 19:00:45 user nova-compute[71692]: No targets found.
Apr 13 19:00:45 user nova-compute[71692]: STATIC:
Apr 13 19:00:45 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02
Apr 13 19:00:45 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:00:45 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:00:45 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9
Apr 13 19:00:45 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:00:45 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:00:45 user nova-compute[71692]: FIRMWARE:
Apr 13 19:00:45 user nova-compute[71692]: No targets found.
Apr 13 19:00:45 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:00:45 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:00:45 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG nova.network.neutron [req-420b9ddf-c768-4ec3-b313-2eba3b3482bd req-8cff3e28-94a4-4cc5-88c5-16ca739cb98d service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Updated VIF entry in instance network info cache for port 5a439b7e-d075-4d9e-9673-523b5aa356fd. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG nova.network.neutron [req-420b9ddf-c768-4ec3-b313-2eba3b3482bd req-8cff3e28-94a4-4cc5-88c5-16ca739cb98d service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Updating instance_info_cache with network_info: [{"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6838e144-04ef-4602-b306-9948382f4f16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "fc7af15914c05ded0f464543e0c8651dbfab425c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.690s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebe6a81-29f4-4cb0-b940-2a7c04acea67]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:45 user nova-compute[71692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)
Apr 13 19:00:45 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:45 user nova-compute[71692]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)
Apr 13 19:00:45 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febd8bf68c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9'): ({'sdc'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Removing single pathed devices sdc {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-420b9ddf-c768-4ec3-b313-2eba3b3482bd req-8cff3e28-94a4-4cc5-88c5-16ca739cb98d service nova] Releasing lock "refresh_cache-ca1b4132-15bd-4d4e-8d0c-d074824c888f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[15606a87-89c9-4c43-8d82-249cb5feefac]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[02149388-08f8-4821-ab7f-78e5c57fb983]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flushing IO for device /dev/sdc {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefd533c-028e-44ea-af72-c540cc48411f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c --force-share --output=json" returned: 0 in 0.147s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "fc7af15914c05ded0f464543e0c8651dbfab425c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "fc7af15914c05ded0f464543e0c8651dbfab425c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0896d2-b5b6-49a6-8a72-50bc7af41460]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[77619803-296d-447b-b331-91f9612896d6]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5ae269-8e55-47cd-a887-6f7d7935c535]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9, portal: 172.16.0.220,3260]
Apr 13 19:00:45 user nova-compute[71692]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9, portal: 172.16.0.220,3260] successful.
Apr 13 19:00:45 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c --force-share --output=json" returned: 0 in 0.156s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c,backing_fmt=raw /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d399664-1abf-4042-b921-85145e7117af]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== disconnect_volume: return (423ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c,backing_fmt=raw /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk 1073741824" returned: 0 in 0.055s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "fc7af15914c05ded0f464543e0c8651dbfab425c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c --force-share --output=json" returned: 0 in 0.170s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'migration_context' on Instance uuid ca1b4132-15bd-4d4e-8d0c-d074824c888f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:45 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Rebasing disk image.
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 -F raw /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:46 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Instance destroyed successfully.
Apr 13 19:00:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-657008190',display_name='tempest-ServerActionsTestJSON-server-1417744922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-657008190',id=5,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:57:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-zw23yzik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:00:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG os_vif [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b297ca1-e6, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:46 user nova-compute[71692]: INFO os_vif [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6')
Apr 13 19:00:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojTJyDmn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:00:46 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 19:00:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1d476b-b42a-4d2f-bac9-22f72132bc1a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:00:46 user nova-compute[71692]: No targets found.
Apr 13 19:00:46 user nova-compute[71692]: iSNS:
Apr 13 19:00:46 user nova-compute[71692]: No targets found.
Apr 13 19:00:46 user nova-compute[71692]: STATIC:
Apr 13 19:00:46 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02
Apr 13 19:00:46 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:00:46 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:00:46 user nova-compute[71692]: FIRMWARE:
Apr 13 19:00:46 user nova-compute[71692]: No targets found.
Apr 13 19:00:46 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:00:46 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:00:46 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddd9064-8fbd-4187-96dc-e8939b676890]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[806be8c5-a6da-40ef-987b-9c0e8662444b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:46 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:46 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc2d0700>, {}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Disconnecting from: [] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== disconnect_volume: return (72ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:00:46 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Deleting instance files /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8_del
Apr 13 19:00:46 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Deletion of /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8_del complete
Apr 13 19:00:46 user nova-compute[71692]: INFO nova.virt.block_device [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Booting with volume 09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 at /dev/vdb
Apr 13 19:00:46 user nova-compute[71692]: DEBUG os_brick.utils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[120997fa-7e1f-4c3a-9b3d-62cc1e4d6cd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[64926265-3d49-453c-9dad-c3f6cf528bce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6693669b-1f20-4c1e-a508-f7d482b6b3d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[838c6d42-0d90-4138-b409-9369b5a42652]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:00:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:00:47 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:00:47 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2a5edb-abc9-4a97-bf02-4e8ea1829955]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:00:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:00:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:00:47 user nova-compute[71692]: DEBUG os_brick.utils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:00:47 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating existing volume attachment record: 875bc626-f6c7-42f3-9239-06625b7c2b52 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 -F raw /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk" returned: 0 in 2.428s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Ensure instance console log exists: /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Start _get_guest_xml network_info=[{"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='2b60f4c4fc7161fafc954722a057bdb9',container_format='bare',created_at=2023-04-13T18:58:43Z,direct_url=<?>,disk_format='qcow2',id=7d0d0224-bc69-47f5-a6a5-c6f72a864595,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-167054456-shelved',owner='faabdcc8e61c452ab3b934b1c9501e68',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T18:58:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'c18419f4-6e50-40c7-b591-fe0733046c08', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Obkflcdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'ca1b4132-15bd-4d4e-8d0c-d074824c888f', 'attached_at': '', 'detached_at': '', 'volume_id': '20b015e0-df81-41d5-a1fa-0e7666672a88', 'serial': '20b015e0-df81-41d5-a1fa-0e7666672a88'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:00:48 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:00:48 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:00:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2b60f4c4fc7161fafc954722a057bdb9',container_format='bare',created_at=2023-04-13T18:58:43Z,direct_url=<?>,disk_format='qcow2',id=7d0d0224-bc69-47f5-a6a5-c6f72a864595,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-167054456-shelved',owner='faabdcc8e61c452ab3b934b1c9501e68',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T18:58:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'vcpu_model' on Instance uuid ca1b4132-15bd-4d4e-8d0c-d074824c888f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Obkflcdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:00:48 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:00:48 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:00:48 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260" returned: 21 in 0.038s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb95f21-9a6f-446d-8123-391de0803cd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:00:48 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2a0a8d-f992-4f07-bf66-1e7c145fc241]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88] added
Apr 13 19:00:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1313774f-add4-4afe-994e-6b200302bc2b]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b49795-bb18-4e35-9fb6-e944abb1e3ac]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Obkflcdm {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Obkflcdm" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[286862e1-f8cb-499f-bf63-12a999d40894]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Obkflcdm'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a5bed9-a152-4098-a2df-f888978e7c9e]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ffbe91-1515-40a8-bc21-b47e26095389]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6518265-74f8-4e72-800d-e27be2028233]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88, portal: 172.16.0.220,3260]
Apr 13 19:00:48 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88, portal: 172.16.0.220,3260] successful.
Apr 13 19:00:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d54b26-d73d-44b9-b0e3-b5f23f5d78ea]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[398f3f72-afb8-4692-bb79-de416b8aeac2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:48 user nova-compute[71692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 (non-flash)
Apr 13 19:00:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:48 user nova-compute[71692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 (non-flash)
Apr 13 19:00:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7758125-fb2a-44b2-a42b-8e8d6feea0f2]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:00:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Obkflcdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23036623138343261', 'path': '/dev/sdc'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036623138343261', 'path': '/dev/sdc'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T18:56:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-167054456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-167054456',id=4,image_ref='7d0d0224-bc69-47f5-a6a5-c6f72a864595',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1219895845',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:57:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='faabdcc8e61c452ab3b934b1c9501e68',ramdisk_id='',reservation_id='r-mi7i79i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1546308967',owner_user_name='tempest-AttachVolumeShelveTestJSON-1546308967-project-member',shelved_at='2023-04-13T18:58:46.627461',shelved_host='user',shelved_image_id='7d0d0224-bc69-47f5-a6a5-c6f72a864595'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee6c76c605d54b4f84e0596b27087f0b',uuid=ca1b4132-15bd-4d4e-8d0c-d074824c888f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converting VIF {"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=5a439b7e-d075-4d9e-9673-523b5aa356fd,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a439b7e-d0') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'pci_devices' on Instance uuid ca1b4132-15bd-4d4e-8d0c-d074824c888f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:00:49 user nova-compute[71692]:   <uuid>ca1b4132-15bd-4d4e-8d0c-d074824c888f</uuid>
Apr 13 19:00:49 user nova-compute[71692]:   <name>instance-00000004</name>
Apr 13 19:00:49 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:00:49 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:00:49 user nova-compute[71692]:   <metadata>
Apr 13 19:00:49 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:00:49 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:00:49 user nova-compute[71692]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-167054456</nova:name>
Apr 13 19:00:49 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:00:48</nova:creationTime>
Apr 13 19:00:49 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:00:49 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:00:49 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:00:49 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:00:49 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:00:49 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:00:49 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:00:49 user nova-compute[71692]:       <nova:owner>
Apr 13 19:00:49 user nova-compute[71692]:         <nova:user uuid="ee6c76c605d54b4f84e0596b27087f0b">tempest-AttachVolumeShelveTestJSON-1546308967-project-member</nova:user>
Apr 13 19:00:49 user nova-compute[71692]:         <nova:project uuid="faabdcc8e61c452ab3b934b1c9501e68">tempest-AttachVolumeShelveTestJSON-1546308967</nova:project>
Apr 13 19:00:49 user nova-compute[71692]:       </nova:owner>
Apr 13 19:00:49 user nova-compute[71692]:       <nova:root type="image" uuid="7d0d0224-bc69-47f5-a6a5-c6f72a864595"/>
Apr 13 19:00:49 user nova-compute[71692]:       <nova:ports>
Apr 13 19:00:49 user nova-compute[71692]:         <nova:port uuid="5a439b7e-d075-4d9e-9673-523b5aa356fd">
Apr 13 19:00:49 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 19:00:49 user nova-compute[71692]:         </nova:port>
Apr 13 19:00:49 user nova-compute[71692]:       </nova:ports>
Apr 13 19:00:49 user nova-compute[71692]:     </nova:instance>
Apr 13 19:00:49 user nova-compute[71692]:   </metadata>
Apr 13 19:00:49 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:00:49 user nova-compute[71692]:     <system>
Apr 13 19:00:49 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:00:49 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:00:49 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:00:49 user nova-compute[71692]:       <entry name="serial">ca1b4132-15bd-4d4e-8d0c-d074824c888f</entry>
Apr 13 19:00:49 user nova-compute[71692]:       <entry name="uuid">ca1b4132-15bd-4d4e-8d0c-d074824c888f</entry>
Apr 13 19:00:49 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:00:49 user nova-compute[71692]:     </system>
Apr 13 19:00:49 user nova-compute[71692]:   </sysinfo>
Apr 13 19:00:49 user nova-compute[71692]:   <os>
Apr 13 19:00:49 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:00:49 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:00:49 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:00:49 user nova-compute[71692]:   </os>
Apr 13 19:00:49 user nova-compute[71692]:   <features>
Apr 13 19:00:49 user nova-compute[71692]:     <acpi/>
Apr 13 19:00:49 user nova-compute[71692]:     <apic/>
Apr 13 19:00:49 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:00:49 user nova-compute[71692]:   </features>
Apr 13 19:00:49 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:00:49 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:00:49 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:00:49 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:00:49 user nova-compute[71692]:   </clock>
Apr 13 19:00:49 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:00:49 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:00:49 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:00:49 user nova-compute[71692]:   </cpu>
Apr 13 19:00:49 user nova-compute[71692]:   <devices>
Apr 13 19:00:49 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:00:49 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:00:49 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk"/>
Apr 13 19:00:49 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:00:49 user nova-compute[71692]:     </disk>
Apr 13 19:00:49 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:00:49 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:00:49 user nova-compute[71692]:       <source dev="/dev/sdc"/>
Apr 13 19:00:49 user nova-compute[71692]:       <target dev="vdc" bus="virtio"/>
Apr 13 19:00:49 user nova-compute[71692]:       <serial>20b015e0-df81-41d5-a1fa-0e7666672a88</serial>
Apr 13 19:00:49 user nova-compute[71692]:     </disk>
Apr 13 19:00:49 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:00:49 user nova-compute[71692]:       <mac address="fa:16:3e:55:cb:ae"/>
Apr 13 19:00:49 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:00:49 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:00:49 user nova-compute[71692]:       <target dev="tap5a439b7e-d0"/>
Apr 13 19:00:49 user nova-compute[71692]:     </interface>
Apr 13 19:00:49 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:00:49 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/console.log" append="off"/>
Apr 13 19:00:49 user nova-compute[71692]:     </serial>
Apr 13 19:00:49 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:00:49 user nova-compute[71692]:     <video>
Apr 13 19:00:49 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:00:49 user nova-compute[71692]:     </video>
Apr 13 19:00:49 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:00:49 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:00:49 user nova-compute[71692]:     </rng>
Apr 13 19:00:49 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:00:49 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:00:49 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:00:49 user nova-compute[71692]:     </memballoon>
Apr 13 19:00:49 user nova-compute[71692]:   </devices>
Apr 13 19:00:49 user nova-compute[71692]: </domain>
Apr 13 19:00:49 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T18:56:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-167054456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-167054456',id=4,image_ref='7d0d0224-bc69-47f5-a6a5-c6f72a864595',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1219895845',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:57:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='faabdcc8e61c452ab3b934b1c9501e68',ramdisk_id='',reservation_id='r-mi7i79i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1546308967',owner_user_name='tempest-AttachVolumeShelveTestJSON-1546308967-project-member',shelved_at='2023-04-13T18:58:46.627461',shelved_host='user',shelved_image_id='7d0d0224-bc69-47f5-a6a5-c6f72a864595'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee6c76c605d54b4f84e0596b27087f0b',uuid=ca1b4132-15bd-4d4e-8d0c-d074824c888f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converting VIF {"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=5a439b7e-d075-4d9e-9673-523b5aa356fd,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a439b7e-d0') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG os_vif [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=5a439b7e-d075-4d9e-9673-523b5aa356fd,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a439b7e-d0') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a439b7e-d0, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5a439b7e-d0, col_values=(('external_ids', {'iface-id': '5a439b7e-d075-4d9e-9673-523b5aa356fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:cb:ae', 'vm-uuid': 'ca1b4132-15bd-4d4e-8d0c-d074824c888f'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:49 user nova-compute[71692]: INFO os_vif [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=5a439b7e-d075-4d9e-9673-523b5aa356fd,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a439b7e-d0')
Apr 13 19:00:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:00:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] No VIF found with MAC fa:16:3e:55:cb:ae, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:00:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:00:51 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Creating image(s)
Apr 13 19:00:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "/opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "/opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "/opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.compute.manager [req-1a05deac-977e-4923-8720-c008559a70a5 req-2d6d9c57-46b8-4ae3-bd73-bac6bb9285c3 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received event network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1a05deac-977e-4923-8720-c008559a70a5 req-2d6d9c57-46b8-4ae3-bd73-bac6bb9285c3 service nova] Acquiring lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1a05deac-977e-4923-8720-c008559a70a5 req-2d6d9c57-46b8-4ae3-bd73-bac6bb9285c3 service nova] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1a05deac-977e-4923-8720-c008559a70a5 req-2d6d9c57-46b8-4ae3-bd73-bac6bb9285c3 service nova] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.compute.manager [req-1a05deac-977e-4923-8720-c008559a70a5 req-2d6d9c57-46b8-4ae3-bd73-bac6bb9285c3 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] No waiting events found dispatching network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:00:52 user nova-compute[71692]: WARNING nova.compute.manager [req-1a05deac-977e-4923-8720-c008559a70a5 req-2d6d9c57-46b8-4ae3-bd73-bac6bb9285c3 service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received unexpected event network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.220s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.130s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk 1073741824" returned: 0 in 0.060s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.138s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Cannot resize image /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Ensure instance console log exists: /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Start _get_guest_xml network_info=[{"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '875bc626-f6c7-42f3-9239-06625b7c2b52', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojTJyDmn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8', 'attached_at': '', 'detached_at': '', 'volume_id': '09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9', 'serial': '09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:00:52 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 13 19:00:52 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.objects.instance [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'vcpu_model' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojTJyDmn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:00:52 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 19:00:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:00:52 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 19:00:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:00:52 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78332cd-4343-4d86-834b-463209276d3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:00:52 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c234a3-84a7-4a98-94d3-24d317724762]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9] added
Apr 13 19:00:52 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[582e1f63-2d36-49ff-8103-14209778e34f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6075a4-18ec-4ed5-958e-4f1afb329ad2]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ojTJyDmn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ojTJyDmn" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f34b8f-210e-42fd-9047-bdbcaef0761d]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ojTJyDmn'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[489e977a-8c59-4841-97e4-2770a1a7cd52]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d868613-042d-44a1-94b3-4ab59ea9a541]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:52 user nova-compute[71692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 (non-flash)
Apr 13 19:00:52 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:52 user nova-compute[71692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 (non-flash)
Apr 13 19:00:52 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d562de0b-d4da-43fe-ada7-a2f4a59c39dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9, portal: 172.16.0.220,3260]
Apr 13 19:00:52 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9, portal: 172.16.0.220,3260] successful.
Apr 13 19:00:52 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d7b830-c590-4d18-92c7-44a8e2d62435]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf327826-0be4-404a-8d28-2f086b6c1d56]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:53 user nova-compute[71692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 (non-flash)
Apr 13 19:00:53 user nova-compute[71692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)
Apr 13 19:00:53 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:00:53 user nova-compute[71692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 (non-flash)
Apr 13 19:00:53 user nova-compute[71692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)
Apr 13 19:00:53 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86ee8d2-313d-486d-a3bd-4ba178f4841a]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412453.6182477, ca1b4132-15bd-4d4e-8d0c-d074824c888f => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:00:53 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] VM Resumed (Lifecycle Event)
Apr 13 19:00:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:00:53 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Instance spawned successfully.
Apr 13 19:00:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:00:53 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:00:53 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412453.624243, ca1b4132-15bd-4d4e-8d0c-d074824c888f => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:00:53 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] VM Started (Lifecycle Event)
Apr 13 19:00:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:00:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:00:53 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:00:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0fb7a356-24d3-406c-9f35-c5673ba74ed4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.490s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojTJyDmn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23234613239623439', 'path': '/dev/sdd'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234613239623439', 'path': '/dev/sdd'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T18:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-657008190',display_name='tempest-ServerActionsTestJSON-server-1417744922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-657008190',id=5,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:57:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-zw23yzik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:00:54 user nova-compute[71692]:   <uuid>b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8</uuid>
Apr 13 19:00:54 user nova-compute[71692]:   <name>instance-00000005</name>
Apr 13 19:00:54 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:00:54 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:00:54 user nova-compute[71692]:   <metadata>
Apr 13 19:00:54 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:00:54 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:00:54 user nova-compute[71692]:       <nova:name>tempest-ServerActionsTestJSON-server-1417744922</nova:name>
Apr 13 19:00:54 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:00:52</nova:creationTime>
Apr 13 19:00:54 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:00:54 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:00:54 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:00:54 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:00:54 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:00:54 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:00:54 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:00:54 user nova-compute[71692]:       <nova:owner>
Apr 13 19:00:54 user nova-compute[71692]:         <nova:user uuid="df209814208d415e9d414d39205aaad6">tempest-ServerActionsTestJSON-1901931474-project-member</nova:user>
Apr 13 19:00:54 user nova-compute[71692]:         <nova:project uuid="c162f91cba4b4ecf9de48fbf839da261">tempest-ServerActionsTestJSON-1901931474</nova:project>
Apr 13 19:00:54 user nova-compute[71692]:       </nova:owner>
Apr 13 19:00:54 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:00:54 user nova-compute[71692]:       <nova:ports>
Apr 13 19:00:54 user nova-compute[71692]:         <nova:port uuid="2b297ca1-e672-438a-917a-df2319262bc0">
Apr 13 19:00:54 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 19:00:54 user nova-compute[71692]:         </nova:port>
Apr 13 19:00:54 user nova-compute[71692]:       </nova:ports>
Apr 13 19:00:54 user nova-compute[71692]:     </nova:instance>
Apr 13 19:00:54 user nova-compute[71692]:   </metadata>
Apr 13 19:00:54 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:00:54 user nova-compute[71692]:     <system>
Apr 13 19:00:54 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:00:54 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:00:54 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:00:54 user nova-compute[71692]:       <entry name="serial">b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8</entry>
Apr 13 19:00:54 user nova-compute[71692]:       <entry name="uuid">b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8</entry>
Apr 13 19:00:54 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:00:54 user nova-compute[71692]:     </system>
Apr 13 19:00:54 user nova-compute[71692]:   </sysinfo>
Apr 13 19:00:54 user nova-compute[71692]:   <os>
Apr 13 19:00:54 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:00:54 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:00:54 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:00:54 user nova-compute[71692]:   </os>
Apr 13 19:00:54 user nova-compute[71692]:   <features>
Apr 13 19:00:54 user nova-compute[71692]:     <acpi/>
Apr 13 19:00:54 user nova-compute[71692]:     <apic/>
Apr 13 19:00:54 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:00:54 user nova-compute[71692]:   </features>
Apr 13 19:00:54 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:00:54 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:00:54 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:00:54 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:00:54 user nova-compute[71692]:   </clock>
Apr 13 19:00:54 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:00:54 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:00:54 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:00:54 user nova-compute[71692]:   </cpu>
Apr 13 19:00:54 user nova-compute[71692]:   <devices>
Apr 13 19:00:54 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:00:54 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:00:54 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk"/>
Apr 13 19:00:54 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:00:54 user nova-compute[71692]:     </disk>
Apr 13 19:00:54 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:00:54 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:00:54 user nova-compute[71692]:       <source dev="/dev/sdd"/>
Apr 13 19:00:54 user nova-compute[71692]:       <target dev="vdb" bus="virtio"/>
Apr 13 19:00:54 user nova-compute[71692]:       <serial>09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9</serial>
Apr 13 19:00:54 user nova-compute[71692]:     </disk>
Apr 13 19:00:54 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:00:54 user nova-compute[71692]:       <mac address="fa:16:3e:bc:71:09"/>
Apr 13 19:00:54 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:00:54 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:00:54 user nova-compute[71692]:       <target dev="tap2b297ca1-e6"/>
Apr 13 19:00:54 user nova-compute[71692]:     </interface>
Apr 13 19:00:54 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:00:54 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/console.log" append="off"/>
Apr 13 19:00:54 user nova-compute[71692]:     </serial>
Apr 13 19:00:54 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:00:54 user nova-compute[71692]:     <video>
Apr 13 19:00:54 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:00:54 user nova-compute[71692]:     </video>
Apr 13 19:00:54 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:00:54 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:00:54 user nova-compute[71692]:     </rng>
Apr 13 19:00:54 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:00:54 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:00:54 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:00:54 user nova-compute[71692]:     </memballoon>
Apr 13 19:00:54 user nova-compute[71692]:   </devices>
Apr 13 19:00:54 user nova-compute[71692]: </domain>
Apr 13 19:00:54 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T18:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-657008190',display_name='tempest-ServerActionsTestJSON-server-1417744922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-657008190',id=5,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:57:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-zw23yzik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG os_vif [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b297ca1-e6, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b297ca1-e6, col_values=(('external_ids', {'iface-id': '2b297ca1-e672-438a-917a-df2319262bc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:71:09', 'vm-uuid': 'b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:54 user nova-compute[71692]: INFO os_vif [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6')
Apr 13 19:00:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No VIF found with MAC fa:16:3e:bc:71:09, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-c8820640-17f7-4f0c-bc02-dbde11e5483b req-16e93d21-1236-4925-888d-5ccf72662b9e service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received event network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c8820640-17f7-4f0c-bc02-dbde11e5483b req-16e93d21-1236-4925-888d-5ccf72662b9e service nova] Acquiring lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c8820640-17f7-4f0c-bc02-dbde11e5483b req-16e93d21-1236-4925-888d-5ccf72662b9e service nova] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c8820640-17f7-4f0c-bc02-dbde11e5483b req-16e93d21-1236-4925-888d-5ccf72662b9e service nova] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-c8820640-17f7-4f0c-bc02-dbde11e5483b req-16e93d21-1236-4925-888d-5ccf72662b9e service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] No waiting events found dispatching network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:00:54 user nova-compute[71692]: WARNING nova.compute.manager [req-c8820640-17f7-4f0c-bc02-dbde11e5483b req-16e93d21-1236-4925-888d-5ccf72662b9e service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received unexpected event network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd for instance with vm_state active and task_state None.
Apr 13 19:00:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:00:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] No waiting events found dispatching network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:00:56 user nova-compute[71692]: WARNING nova.compute.manager [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received unexpected event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 for instance with vm_state active and task_state rebuild_spawning.
Apr 13 19:00:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:00:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] No waiting events found dispatching network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:00:56 user nova-compute[71692]: WARNING nova.compute.manager [req-1faa6bf9-7f11-4774-85dd-6bb5e388923e req-6c8ed294-89a6-4856-b29b-51a947ef4017 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received unexpected event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 for instance with vm_state active and task_state rebuild_spawning.
Apr 13 19:00:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:00:57 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Removed pending event for b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 due to event {{(pid=71692) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 19:00:57 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412457.9892926, b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:00:57 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] VM Resumed (Lifecycle Event)
Apr 13 19:00:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:00:57 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:00:58 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Instance spawned successfully.
Apr 13 19:00:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:00:58 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:00:58 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:00:58 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 13 19:00:58 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412457.989747, b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:00:58 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] VM Started (Lifecycle Event)
Apr 13 19:00:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:00:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:00:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:00:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:00:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:00:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:00:58 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:00:58 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:00:58 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 13 19:00:58 user nova-compute[71692]: DEBUG nova.compute.manager [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:00:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:00:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:00:58 user nova-compute[71692]: DEBUG nova.objects.instance [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71692) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 13 19:00:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6fb8ec0e-86f4-4b36-9795-394c28337402 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.071s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:00:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "33b4d519-a2df-4278-afbc-4ce7637b04ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "33b4d519-a2df-4278-afbc-4ce7637b04ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:01:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:05 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:01:05 user nova-compute[71692]: INFO nova.compute.claims [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Claim successful on node user
Apr 13 19:01:05 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:01:05 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:01:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:01:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:01:05 user nova-compute[71692]: DEBUG nova.network.neutron [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:01:05 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:01:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:01:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG nova.policy [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1b0d9cad8c64a8ea80420d5d8efe16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f74f6b4f68416ebdb496adc62a48ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:01:06 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Creating image(s)
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "/opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "/opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "/opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.187s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.153s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk 1073741824" returned: 0 in 0.052s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Cannot resize image /opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG nova.objects.instance [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lazy-loading 'migration_context' on Instance uuid 33b4d519-a2df-4278-afbc-4ce7637b04ab {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Ensure instance console log exists: /opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:06 user nova-compute[71692]: DEBUG nova.network.neutron [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Successfully created port: 83a60571-08e5-4d6e-8582-5ec7c0304ec1 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:01:07 user nova-compute[71692]: DEBUG nova.network.neutron [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Successfully updated port: 83a60571-08e5-4d6e-8582-5ec7c0304ec1 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:01:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "refresh_cache-33b4d519-a2df-4278-afbc-4ce7637b04ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:01:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquired lock "refresh_cache-33b4d519-a2df-4278-afbc-4ce7637b04ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:01:07 user nova-compute[71692]: DEBUG nova.network.neutron [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:01:07 user nova-compute[71692]: DEBUG nova.compute.manager [req-9ea080a3-9bda-4302-82a1-79749e8b83a8 req-d38dabf7-680a-4234-8306-fd3002eb9b5d service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Received event network-changed-83a60571-08e5-4d6e-8582-5ec7c0304ec1 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:01:07 user nova-compute[71692]: DEBUG nova.compute.manager [req-9ea080a3-9bda-4302-82a1-79749e8b83a8 req-d38dabf7-680a-4234-8306-fd3002eb9b5d service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Refreshing instance network info cache due to event network-changed-83a60571-08e5-4d6e-8582-5ec7c0304ec1. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:01:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9ea080a3-9bda-4302-82a1-79749e8b83a8 req-d38dabf7-680a-4234-8306-fd3002eb9b5d service nova] Acquiring lock "refresh_cache-33b4d519-a2df-4278-afbc-4ce7637b04ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:01:07 user nova-compute[71692]: DEBUG nova.network.neutron [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:01:07 user nova-compute[71692]: DEBUG nova.network.neutron [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Updating instance_info_cache with network_info: [{"id": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "address": "fa:16:3e:a5:9d:99", "network": {"id": "2e8ff947-529b-4387-b2c5-12c423cddf70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-885275796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "94f74f6b4f68416ebdb496adc62a48ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a60571-08", "ovs_interfaceid": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Releasing lock "refresh_cache-33b4d519-a2df-4278-afbc-4ce7637b04ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Instance network_info: |[{"id": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "address": "fa:16:3e:a5:9d:99", "network": {"id": "2e8ff947-529b-4387-b2c5-12c423cddf70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-885275796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "94f74f6b4f68416ebdb496adc62a48ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a60571-08", "ovs_interfaceid": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9ea080a3-9bda-4302-82a1-79749e8b83a8 req-d38dabf7-680a-4234-8306-fd3002eb9b5d service nova] Acquired lock "refresh_cache-33b4d519-a2df-4278-afbc-4ce7637b04ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.network.neutron [req-9ea080a3-9bda-4302-82a1-79749e8b83a8 req-d38dabf7-680a-4234-8306-fd3002eb9b5d service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Refreshing network info cache for port 83a60571-08e5-4d6e-8582-5ec7c0304ec1 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Start _get_guest_xml network_info=[{"id": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "address": "fa:16:3e:a5:9d:99", "network": {"id": "2e8ff947-529b-4387-b2c5-12c423cddf70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-885275796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "94f74f6b4f68416ebdb496adc62a48ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a60571-08", "ovs_interfaceid": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:01:08 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:01:08 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:01:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1142942524',display_name='tempest-VolumesActionsTest-instance-1142942524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1142942524',id=12,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f74f6b4f68416ebdb496adc62a48ed',ramdisk_id='',reservation_id='r-zlq0c2nr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1911230974',owner_user_name='tempest-VolumesActionsTest-1911230974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:01:06Z,user_data=None,user_id='d1b0d9cad8c64a8ea80420d5d8efe16f',uuid=33b4d519-a2df-4278-afbc-4ce7637b04ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "address": "fa:16:3e:a5:9d:99", "network": {"id": "2e8ff947-529b-4387-b2c5-12c423cddf70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-885275796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "94f74f6b4f68416ebdb496adc62a48ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a60571-08", "ovs_interfaceid": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Converting VIF {"id": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "address": "fa:16:3e:a5:9d:99", "network": {"id": "2e8ff947-529b-4387-b2c5-12c423cddf70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-885275796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "94f74f6b4f68416ebdb496adc62a48ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a60571-08", "ovs_interfaceid": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:9d:99,bridge_name='br-int',has_traffic_filtering=True,id=83a60571-08e5-4d6e-8582-5ec7c0304ec1,network=Network(2e8ff947-529b-4387-b2c5-12c423cddf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a60571-08') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.objects.instance [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lazy-loading 'pci_devices' on Instance uuid 33b4d519-a2df-4278-afbc-4ce7637b04ab {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:01:08 user nova-compute[71692]:   <uuid>33b4d519-a2df-4278-afbc-4ce7637b04ab</uuid>
Apr 13 19:01:08 user nova-compute[71692]:   <name>instance-0000000c</name>
Apr 13 19:01:08 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:01:08 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:01:08 user nova-compute[71692]:   <metadata>
Apr 13 19:01:08 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:01:08 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:01:08 user nova-compute[71692]:       <nova:name>tempest-VolumesActionsTest-instance-1142942524</nova:name>
Apr 13 19:01:08 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:01:08</nova:creationTime>
Apr 13 19:01:08 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:01:08 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:01:08 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:01:08 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:01:08 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:01:08 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:01:08 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:01:08 user nova-compute[71692]:       <nova:owner>
Apr 13 19:01:08 user nova-compute[71692]:         <nova:user uuid="d1b0d9cad8c64a8ea80420d5d8efe16f">tempest-VolumesActionsTest-1911230974-project-member</nova:user>
Apr 13 19:01:08 user nova-compute[71692]:         <nova:project uuid="94f74f6b4f68416ebdb496adc62a48ed">tempest-VolumesActionsTest-1911230974</nova:project>
Apr 13 19:01:08 user nova-compute[71692]:       </nova:owner>
Apr 13 19:01:08 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:01:08 user nova-compute[71692]:       <nova:ports>
Apr 13 19:01:08 user nova-compute[71692]:         <nova:port uuid="83a60571-08e5-4d6e-8582-5ec7c0304ec1">
Apr 13 19:01:08 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 19:01:08 user nova-compute[71692]:         </nova:port>
Apr 13 19:01:08 user nova-compute[71692]:       </nova:ports>
Apr 13 19:01:08 user nova-compute[71692]:     </nova:instance>
Apr 13 19:01:08 user nova-compute[71692]:   </metadata>
Apr 13 19:01:08 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:01:08 user nova-compute[71692]:     <system>
Apr 13 19:01:08 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:01:08 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:01:08 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:01:08 user nova-compute[71692]:       <entry name="serial">33b4d519-a2df-4278-afbc-4ce7637b04ab</entry>
Apr 13 19:01:08 user nova-compute[71692]:       <entry name="uuid">33b4d519-a2df-4278-afbc-4ce7637b04ab</entry>
Apr 13 19:01:08 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:01:08 user nova-compute[71692]:     </system>
Apr 13 19:01:08 user nova-compute[71692]:   </sysinfo>
Apr 13 19:01:08 user nova-compute[71692]:   <os>
Apr 13 19:01:08 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:01:08 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:01:08 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:01:08 user nova-compute[71692]:   </os>
Apr 13 19:01:08 user nova-compute[71692]:   <features>
Apr 13 19:01:08 user nova-compute[71692]:     <acpi/>
Apr 13 19:01:08 user nova-compute[71692]:     <apic/>
Apr 13 19:01:08 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:01:08 user nova-compute[71692]:   </features>
Apr 13 19:01:08 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:01:08 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:01:08 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:01:08 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:01:08 user nova-compute[71692]:   </clock>
Apr 13 19:01:08 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:01:08 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:01:08 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:01:08 user nova-compute[71692]:   </cpu>
Apr 13 19:01:08 user nova-compute[71692]:   <devices>
Apr 13 19:01:08 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:01:08 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:01:08 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk"/>
Apr 13 19:01:08 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:01:08 user nova-compute[71692]:     </disk>
Apr 13 19:01:08 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:01:08 user nova-compute[71692]:       <mac address="fa:16:3e:a5:9d:99"/>
Apr 13 19:01:08 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:01:08 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:01:08 user nova-compute[71692]:       <target dev="tap83a60571-08"/>
Apr 13 19:01:08 user nova-compute[71692]:     </interface>
Apr 13 19:01:08 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:01:08 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/console.log" append="off"/>
Apr 13 19:01:08 user nova-compute[71692]:     </serial>
Apr 13 19:01:08 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:01:08 user nova-compute[71692]:     <video>
Apr 13 19:01:08 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:01:08 user nova-compute[71692]:     </video>
Apr 13 19:01:08 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:01:08 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:01:08 user nova-compute[71692]:     </rng>
Apr 13 19:01:08 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:01:08 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:01:08 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:01:08 user nova-compute[71692]:     </memballoon>
Apr 13 19:01:08 user nova-compute[71692]:   </devices>
Apr 13 19:01:08 user nova-compute[71692]: </domain>
Apr 13 19:01:08 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:01:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1142942524',display_name='tempest-VolumesActionsTest-instance-1142942524',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1142942524',id=12,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94f74f6b4f68416ebdb496adc62a48ed',ramdisk_id='',reservation_id='r-zlq0c2nr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1911230974',owner_user_name='tempest-VolumesActionsTest-1911230974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:01:06Z,user_data=None,user_id='d1b0d9cad8c64a8ea80420d5d8efe16f',uuid=33b4d519-a2df-4278-afbc-4ce7637b04ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "address": "fa:16:3e:a5:9d:99", "network": {"id": "2e8ff947-529b-4387-b2c5-12c423cddf70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-885275796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "94f74f6b4f68416ebdb496adc62a48ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a60571-08", "ovs_interfaceid": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Converting VIF {"id": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "address": "fa:16:3e:a5:9d:99", "network": {"id": "2e8ff947-529b-4387-b2c5-12c423cddf70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-885275796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "94f74f6b4f68416ebdb496adc62a48ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a60571-08", "ovs_interfaceid": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:9d:99,bridge_name='br-int',has_traffic_filtering=True,id=83a60571-08e5-4d6e-8582-5ec7c0304ec1,network=Network(2e8ff947-529b-4387-b2c5-12c423cddf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a60571-08') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG os_vif [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:9d:99,bridge_name='br-int',has_traffic_filtering=True,id=83a60571-08e5-4d6e-8582-5ec7c0304ec1,network=Network(2e8ff947-529b-4387-b2c5-12c423cddf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a60571-08') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83a60571-08, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap83a60571-08, col_values=(('external_ids', {'iface-id': '83a60571-08e5-4d6e-8582-5ec7c0304ec1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:9d:99', 'vm-uuid': '33b4d519-a2df-4278-afbc-4ce7637b04ab'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:08 user nova-compute[71692]: INFO os_vif [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:9d:99,bridge_name='br-int',has_traffic_filtering=True,id=83a60571-08e5-4d6e-8582-5ec7c0304ec1,network=Network(2e8ff947-529b-4387-b2c5-12c423cddf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a60571-08')
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] No VIF found with MAC fa:16:3e:a5:9d:99, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.network.neutron [req-9ea080a3-9bda-4302-82a1-79749e8b83a8 req-d38dabf7-680a-4234-8306-fd3002eb9b5d service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Updated VIF entry in instance network info cache for port 83a60571-08e5-4d6e-8582-5ec7c0304ec1. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG nova.network.neutron [req-9ea080a3-9bda-4302-82a1-79749e8b83a8 req-d38dabf7-680a-4234-8306-fd3002eb9b5d service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Updating instance_info_cache with network_info: [{"id": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "address": "fa:16:3e:a5:9d:99", "network": {"id": "2e8ff947-529b-4387-b2c5-12c423cddf70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-885275796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "94f74f6b4f68416ebdb496adc62a48ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a60571-08", "ovs_interfaceid": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:01:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9ea080a3-9bda-4302-82a1-79749e8b83a8 req-d38dabf7-680a-4234-8306-fd3002eb9b5d service nova] Releasing lock "refresh_cache-33b4d519-a2df-4278-afbc-4ce7637b04ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:01:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:09 user nova-compute[71692]: DEBUG nova.compute.manager [req-5cb0fe64-f730-4bc5-b7be-0bf7757c9170 req-4e75a57b-d2f4-480b-9733-7e496846f1e6 service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Received event network-vif-plugged-83a60571-08e5-4d6e-8582-5ec7c0304ec1 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:01:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5cb0fe64-f730-4bc5-b7be-0bf7757c9170 req-4e75a57b-d2f4-480b-9733-7e496846f1e6 service nova] Acquiring lock "33b4d519-a2df-4278-afbc-4ce7637b04ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5cb0fe64-f730-4bc5-b7be-0bf7757c9170 req-4e75a57b-d2f4-480b-9733-7e496846f1e6 service nova] Lock "33b4d519-a2df-4278-afbc-4ce7637b04ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5cb0fe64-f730-4bc5-b7be-0bf7757c9170 req-4e75a57b-d2f4-480b-9733-7e496846f1e6 service nova] Lock "33b4d519-a2df-4278-afbc-4ce7637b04ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:09 user nova-compute[71692]: DEBUG nova.compute.manager [req-5cb0fe64-f730-4bc5-b7be-0bf7757c9170 req-4e75a57b-d2f4-480b-9733-7e496846f1e6 service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] No waiting events found dispatching network-vif-plugged-83a60571-08e5-4d6e-8582-5ec7c0304ec1 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:01:09 user nova-compute[71692]: WARNING nova.compute.manager [req-5cb0fe64-f730-4bc5-b7be-0bf7757c9170 req-4e75a57b-d2f4-480b-9733-7e496846f1e6 service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Received unexpected event network-vif-plugged-83a60571-08e5-4d6e-8582-5ec7c0304ec1 for instance with vm_state building and task_state spawning.
Apr 13 19:01:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:11 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412471.654264, 33b4d519-a2df-4278-afbc-4ce7637b04ab => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:01:11 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] VM Resumed (Lifecycle Event)
Apr 13 19:01:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:01:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:01:11 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Instance spawned successfully.
Apr 13 19:01:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:01:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:01:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:01:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:01:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:01:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:01:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:01:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:01:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:01:11 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:01:11 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412471.6560414, 33b4d519-a2df-4278-afbc-4ce7637b04ab => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:01:11 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] VM Started (Lifecycle Event)
Apr 13 19:01:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:01:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:01:11 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:01:11 user nova-compute[71692]: INFO nova.compute.manager [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Took 5.66 seconds to spawn the instance on the hypervisor.
Apr 13 19:01:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:01:11 user nova-compute[71692]: INFO nova.compute.manager [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Took 6.35 seconds to build instance.
Apr 13 19:01:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-91d24303-32bb-40ca-9a41-029377741c99 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "33b4d519-a2df-4278-afbc-4ce7637b04ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.450s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-0c8574c2-b9f3-4265-adeb-17ad79366854 req-6ef2ceb3-86cc-4b95-b22e-b987f7cb7681 service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Received event network-vif-plugged-83a60571-08e5-4d6e-8582-5ec7c0304ec1 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:01:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0c8574c2-b9f3-4265-adeb-17ad79366854 req-6ef2ceb3-86cc-4b95-b22e-b987f7cb7681 service nova] Acquiring lock "33b4d519-a2df-4278-afbc-4ce7637b04ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0c8574c2-b9f3-4265-adeb-17ad79366854 req-6ef2ceb3-86cc-4b95-b22e-b987f7cb7681 service nova] Lock "33b4d519-a2df-4278-afbc-4ce7637b04ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0c8574c2-b9f3-4265-adeb-17ad79366854 req-6ef2ceb3-86cc-4b95-b22e-b987f7cb7681 service nova] Lock "33b4d519-a2df-4278-afbc-4ce7637b04ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-0c8574c2-b9f3-4265-adeb-17ad79366854 req-6ef2ceb3-86cc-4b95-b22e-b987f7cb7681 service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] No waiting events found dispatching network-vif-plugged-83a60571-08e5-4d6e-8582-5ec7c0304ec1 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:01:12 user nova-compute[71692]: WARNING nova.compute.manager [req-0c8574c2-b9f3-4265-adeb-17ad79366854 req-6ef2ceb3-86cc-4b95-b22e-b987f7cb7681 service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Received unexpected event network-vif-plugged-83a60571-08e5-4d6e-8582-5ec7c0304ec1 for instance with vm_state active and task_state None.
Apr 13 19:01:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:30 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:01:30 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:01:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:31 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:01:31 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:01:31 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:01:31 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:01:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:31 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:01:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:32 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:01:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:01:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:01:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:34 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:01:34 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:01:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8014MB free_disk=26.347389221191406GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:01:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance a15c1b5e-1769-490a-b81f-09333cd4a227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:01:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance f17525a6-e377-4b33-85cd-88a7aaf4569a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:01:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:01:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 106da0b9-c823-4f26-874c-53f8ad235e61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:01:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 81690e5b-0bcc-4e7c-87b6-e51a30571888 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:01:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:01:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 33b4d519-a2df-4278-afbc-4ce7637b04ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:01:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:01:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:01:34 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:01:34 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:01:34 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:01:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:35 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:01:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:01:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-106da0b9-c823-4f26-874c-53f8ad235e61" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:01:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-106da0b9-c823-4f26-874c-53f8ad235e61" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:01:35 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:01:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:36 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Updating instance_info_cache with network_info: [{"id": "8638d612-5f79-496f-8be2-db6706c14211", "address": "fa:16:3e:c4:f2:9f", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8638d612-5f", "ovs_interfaceid": "8638d612-5f79-496f-8be2-db6706c14211", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:01:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-106da0b9-c823-4f26-874c-53f8ad235e61" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:01:36 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:01:36 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:01:36 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:01:36 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:01:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:01:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:48 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:01:48 user nova-compute[71692]: INFO nova.compute.claims [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Claim successful on node user
Apr 13 19:01:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:48 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:01:48 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:01:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:48 user nova-compute[71692]: DEBUG nova.compute.manager [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:01:48 user nova-compute[71692]: DEBUG nova.compute.manager [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:01:48 user nova-compute[71692]: DEBUG nova.network.neutron [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:01:48 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:01:48 user nova-compute[71692]: DEBUG nova.compute.manager [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:01:48 user nova-compute[71692]: DEBUG nova.compute.manager [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:01:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:01:48 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Creating image(s)
Apr 13 19:01:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "/opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "/opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "/opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.062s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:48 user nova-compute[71692]: DEBUG nova.policy [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ff67e015f5c4480919a0bd503abedc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a4f50c893404b94c839e86a55b47c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:01:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.158s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.163s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk 1073741824" returned: 0 in 0.058s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:49 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:01:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:49 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Cannot resize image /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:01:49 user nova-compute[71692]: DEBUG nova.objects.instance [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lazy-loading 'migration_context' on Instance uuid 20edda40-d5dd-4c56-9c5d-023cfd330c8e {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:01:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:01:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Ensure instance console log exists: /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:01:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:49 user nova-compute[71692]: DEBUG nova.network.neutron [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Successfully created port: b5d1f04b-5691-4b8b-a52c-d54bdb160292 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:01:50 user nova-compute[71692]: DEBUG nova.network.neutron [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Successfully updated port: b5d1f04b-5691-4b8b-a52c-d54bdb160292 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:01:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:01:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquired lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:01:50 user nova-compute[71692]: DEBUG nova.network.neutron [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:01:50 user nova-compute[71692]: DEBUG nova.network.neutron [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:01:50 user nova-compute[71692]: DEBUG nova.compute.manager [req-7b50a6c6-220e-4ad0-9632-19b682deddf0 req-d46cbd90-c849-4fb2-abfc-5913264c99bf service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received event network-changed-b5d1f04b-5691-4b8b-a52c-d54bdb160292 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:01:50 user nova-compute[71692]: DEBUG nova.compute.manager [req-7b50a6c6-220e-4ad0-9632-19b682deddf0 req-d46cbd90-c849-4fb2-abfc-5913264c99bf service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Refreshing instance network info cache due to event network-changed-b5d1f04b-5691-4b8b-a52c-d54bdb160292. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:01:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7b50a6c6-220e-4ad0-9632-19b682deddf0 req-d46cbd90-c849-4fb2-abfc-5913264c99bf service nova] Acquiring lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:01:50 user nova-compute[71692]: DEBUG nova.network.neutron [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Updating instance_info_cache with network_info: [{"id": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "address": "fa:16:3e:10:5a:ab", "network": {"id": "3a84ff5b-fe4e-41eb-8cf9-6882fbec0275", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2050735987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d1f04b-56", "ovs_interfaceid": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:01:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Releasing lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:01:50 user nova-compute[71692]: DEBUG nova.compute.manager [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Instance network_info: |[{"id": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "address": "fa:16:3e:10:5a:ab", "network": {"id": "3a84ff5b-fe4e-41eb-8cf9-6882fbec0275", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2050735987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d1f04b-56", "ovs_interfaceid": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7b50a6c6-220e-4ad0-9632-19b682deddf0 req-d46cbd90-c849-4fb2-abfc-5913264c99bf service nova] Acquired lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.network.neutron [req-7b50a6c6-220e-4ad0-9632-19b682deddf0 req-d46cbd90-c849-4fb2-abfc-5913264c99bf service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Refreshing network info cache for port b5d1f04b-5691-4b8b-a52c-d54bdb160292 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Start _get_guest_xml network_info=[{"id": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "address": "fa:16:3e:10:5a:ab", "network": {"id": "3a84ff5b-fe4e-41eb-8cf9-6882fbec0275", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2050735987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d1f04b-56", "ovs_interfaceid": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:51 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:01:51 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-266550598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-266550598',id=13,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANNcqbVyx2+AlA6pJ67iCyDqokC0vj/8HKOcvYaotnci2ghezOK0wR9sJjzbtG6QMuvPDsNIPT54X8tzc1iHMAgDLsmrG5h7nHcBGX8mEcxODCqL7xCBPS67OL15k/VWg==',key_name='tempest-keypair-883887520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee3a4f50c893404b94c839e86a55b47c',ramdisk_id='',reservation_id='r-ulgl580f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1514135387',owner_user_name='tempest-TaggedAttachmentsTest-1514135387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:01:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ff67e015f5c4480919a0bd503abedc3',uuid=20edda40-d5dd-4c56-9c5d-023cfd330c8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "address": "fa:16:3e:10:5a:ab", "network": {"id": "3a84ff5b-fe4e-41eb-8cf9-6882fbec0275", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2050735987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d1f04b-56", "ovs_interfaceid": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Converting VIF {"id": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "address": "fa:16:3e:10:5a:ab", "network": {"id": "3a84ff5b-fe4e-41eb-8cf9-6882fbec0275", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2050735987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d1f04b-56", "ovs_interfaceid": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:5a:ab,bridge_name='br-int',has_traffic_filtering=True,id=b5d1f04b-5691-4b8b-a52c-d54bdb160292,network=Network(3a84ff5b-fe4e-41eb-8cf9-6882fbec0275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d1f04b-56') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.objects.instance [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lazy-loading 'pci_devices' on Instance uuid 20edda40-d5dd-4c56-9c5d-023cfd330c8e {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:01:51 user nova-compute[71692]:   <uuid>20edda40-d5dd-4c56-9c5d-023cfd330c8e</uuid>
Apr 13 19:01:51 user nova-compute[71692]:   <name>instance-0000000d</name>
Apr 13 19:01:51 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:01:51 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:01:51 user nova-compute[71692]:   <metadata>
Apr 13 19:01:51 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:01:51 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:01:51 user nova-compute[71692]:       <nova:name>tempest-device-tagging-server-266550598</nova:name>
Apr 13 19:01:51 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:01:51</nova:creationTime>
Apr 13 19:01:51 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:01:51 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:01:51 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:01:51 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:01:51 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:01:51 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:01:51 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:01:51 user nova-compute[71692]:       <nova:owner>
Apr 13 19:01:51 user nova-compute[71692]:         <nova:user uuid="3ff67e015f5c4480919a0bd503abedc3">tempest-TaggedAttachmentsTest-1514135387-project-member</nova:user>
Apr 13 19:01:51 user nova-compute[71692]:         <nova:project uuid="ee3a4f50c893404b94c839e86a55b47c">tempest-TaggedAttachmentsTest-1514135387</nova:project>
Apr 13 19:01:51 user nova-compute[71692]:       </nova:owner>
Apr 13 19:01:51 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:01:51 user nova-compute[71692]:       <nova:ports>
Apr 13 19:01:51 user nova-compute[71692]:         <nova:port uuid="b5d1f04b-5691-4b8b-a52c-d54bdb160292">
Apr 13 19:01:51 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 19:01:51 user nova-compute[71692]:         </nova:port>
Apr 13 19:01:51 user nova-compute[71692]:       </nova:ports>
Apr 13 19:01:51 user nova-compute[71692]:     </nova:instance>
Apr 13 19:01:51 user nova-compute[71692]:   </metadata>
Apr 13 19:01:51 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:01:51 user nova-compute[71692]:     <system>
Apr 13 19:01:51 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:01:51 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:01:51 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:01:51 user nova-compute[71692]:       <entry name="serial">20edda40-d5dd-4c56-9c5d-023cfd330c8e</entry>
Apr 13 19:01:51 user nova-compute[71692]:       <entry name="uuid">20edda40-d5dd-4c56-9c5d-023cfd330c8e</entry>
Apr 13 19:01:51 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:01:51 user nova-compute[71692]:     </system>
Apr 13 19:01:51 user nova-compute[71692]:   </sysinfo>
Apr 13 19:01:51 user nova-compute[71692]:   <os>
Apr 13 19:01:51 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:01:51 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:01:51 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:01:51 user nova-compute[71692]:   </os>
Apr 13 19:01:51 user nova-compute[71692]:   <features>
Apr 13 19:01:51 user nova-compute[71692]:     <acpi/>
Apr 13 19:01:51 user nova-compute[71692]:     <apic/>
Apr 13 19:01:51 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:01:51 user nova-compute[71692]:   </features>
Apr 13 19:01:51 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:01:51 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:01:51 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:01:51 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:01:51 user nova-compute[71692]:   </clock>
Apr 13 19:01:51 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:01:51 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:01:51 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:01:51 user nova-compute[71692]:   </cpu>
Apr 13 19:01:51 user nova-compute[71692]:   <devices>
Apr 13 19:01:51 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:01:51 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:01:51 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk"/>
Apr 13 19:01:51 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:01:51 user nova-compute[71692]:     </disk>
Apr 13 19:01:51 user nova-compute[71692]:     <disk type="file" device="cdrom">
Apr 13 19:01:51 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 19:01:51 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk.config"/>
Apr 13 19:01:51 user nova-compute[71692]:       <target dev="hda" bus="ide"/>
Apr 13 19:01:51 user nova-compute[71692]:     </disk>
Apr 13 19:01:51 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:01:51 user nova-compute[71692]:       <mac address="fa:16:3e:10:5a:ab"/>
Apr 13 19:01:51 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:01:51 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:01:51 user nova-compute[71692]:       <target dev="tapb5d1f04b-56"/>
Apr 13 19:01:51 user nova-compute[71692]:     </interface>
Apr 13 19:01:51 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:01:51 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/console.log" append="off"/>
Apr 13 19:01:51 user nova-compute[71692]:     </serial>
Apr 13 19:01:51 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:01:51 user nova-compute[71692]:     <video>
Apr 13 19:01:51 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:01:51 user nova-compute[71692]:     </video>
Apr 13 19:01:51 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:01:51 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:01:51 user nova-compute[71692]:     </rng>
Apr 13 19:01:51 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:01:51 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:01:51 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:01:51 user nova-compute[71692]:     </memballoon>
Apr 13 19:01:51 user nova-compute[71692]:   </devices>
Apr 13 19:01:51 user nova-compute[71692]: </domain>
Apr 13 19:01:51 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-266550598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-266550598',id=13,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANNcqbVyx2+AlA6pJ67iCyDqokC0vj/8HKOcvYaotnci2ghezOK0wR9sJjzbtG6QMuvPDsNIPT54X8tzc1iHMAgDLsmrG5h7nHcBGX8mEcxODCqL7xCBPS67OL15k/VWg==',key_name='tempest-keypair-883887520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee3a4f50c893404b94c839e86a55b47c',ramdisk_id='',reservation_id='r-ulgl580f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1514135387',owner_user_name='tempest-TaggedAttachmentsTest-1514135387-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:01:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ff67e015f5c4480919a0bd503abedc3',uuid=20edda40-d5dd-4c56-9c5d-023cfd330c8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "address": "fa:16:3e:10:5a:ab", "network": {"id": "3a84ff5b-fe4e-41eb-8cf9-6882fbec0275", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2050735987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d1f04b-56", "ovs_interfaceid": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Converting VIF {"id": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "address": "fa:16:3e:10:5a:ab", "network": {"id": "3a84ff5b-fe4e-41eb-8cf9-6882fbec0275", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2050735987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d1f04b-56", "ovs_interfaceid": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:5a:ab,bridge_name='br-int',has_traffic_filtering=True,id=b5d1f04b-5691-4b8b-a52c-d54bdb160292,network=Network(3a84ff5b-fe4e-41eb-8cf9-6882fbec0275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d1f04b-56') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG os_vif [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:5a:ab,bridge_name='br-int',has_traffic_filtering=True,id=b5d1f04b-5691-4b8b-a52c-d54bdb160292,network=Network(3a84ff5b-fe4e-41eb-8cf9-6882fbec0275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d1f04b-56') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5d1f04b-56, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5d1f04b-56, col_values=(('external_ids', {'iface-id': 'b5d1f04b-5691-4b8b-a52c-d54bdb160292', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:5a:ab', 'vm-uuid': '20edda40-d5dd-4c56-9c5d-023cfd330c8e'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:51 user nova-compute[71692]: INFO os_vif [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:5a:ab,bridge_name='br-int',has_traffic_filtering=True,id=b5d1f04b-5691-4b8b-a52c-d54bdb160292,network=Network(3a84ff5b-fe4e-41eb-8cf9-6882fbec0275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d1f04b-56')
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] No BDM found with device name hda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] No VIF found with MAC fa:16:3e:10:5a:ab, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:01:51 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Using config drive
Apr 13 19:01:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "81690e5b-0bcc-4e7c-87b6-e51a30571888" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "81690e5b-0bcc-4e7c-87b6-e51a30571888" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "81690e5b-0bcc-4e7c-87b6-e51a30571888-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "81690e5b-0bcc-4e7c-87b6-e51a30571888-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "81690e5b-0bcc-4e7c-87b6-e51a30571888-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:51 user nova-compute[71692]: INFO nova.compute.manager [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Terminating instance
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:01:51 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Creating config drive at /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk.config
Apr 13 19:01:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptc5h4q3x {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptc5h4q3x" returned: 0 in 0.070s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.compute.manager [req-f7b93612-ab00-45ae-9f63-baa2b545d7e1 req-cc017c3f-a8aa-4cb8-864a-199f2e02a299 service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Received event network-vif-unplugged-97015895-15bd-401e-aa52-776f82605bc4 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f7b93612-ab00-45ae-9f63-baa2b545d7e1 req-cc017c3f-a8aa-4cb8-864a-199f2e02a299 service nova] Acquiring lock "81690e5b-0bcc-4e7c-87b6-e51a30571888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f7b93612-ab00-45ae-9f63-baa2b545d7e1 req-cc017c3f-a8aa-4cb8-864a-199f2e02a299 service nova] Lock "81690e5b-0bcc-4e7c-87b6-e51a30571888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f7b93612-ab00-45ae-9f63-baa2b545d7e1 req-cc017c3f-a8aa-4cb8-864a-199f2e02a299 service nova] Lock "81690e5b-0bcc-4e7c-87b6-e51a30571888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.compute.manager [req-f7b93612-ab00-45ae-9f63-baa2b545d7e1 req-cc017c3f-a8aa-4cb8-864a-199f2e02a299 service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] No waiting events found dispatching network-vif-unplugged-97015895-15bd-401e-aa52-776f82605bc4 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.compute.manager [req-f7b93612-ab00-45ae-9f63-baa2b545d7e1 req-cc017c3f-a8aa-4cb8-864a-199f2e02a299 service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Received event network-vif-unplugged-97015895-15bd-401e-aa52-776f82605bc4 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.network.neutron [req-7b50a6c6-220e-4ad0-9632-19b682deddf0 req-d46cbd90-c849-4fb2-abfc-5913264c99bf service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Updated VIF entry in instance network info cache for port b5d1f04b-5691-4b8b-a52c-d54bdb160292. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG nova.network.neutron [req-7b50a6c6-220e-4ad0-9632-19b682deddf0 req-d46cbd90-c849-4fb2-abfc-5913264c99bf service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Updating instance_info_cache with network_info: [{"id": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "address": "fa:16:3e:10:5a:ab", "network": {"id": "3a84ff5b-fe4e-41eb-8cf9-6882fbec0275", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2050735987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d1f04b-56", "ovs_interfaceid": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7b50a6c6-220e-4ad0-9632-19b682deddf0 req-d46cbd90-c849-4fb2-abfc-5913264c99bf service nova] Releasing lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:01:52 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Instance destroyed successfully.
Apr 13 19:01:52 user nova-compute[71692]: DEBUG nova.objects.instance [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lazy-loading 'resources' on Instance uuid 81690e5b-0bcc-4e7c-87b6-e51a30571888 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:01:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2091050597',display_name='tempest-VolumesAdminNegativeTest-server-2091050597',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2091050597',id=11,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:00:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d708f05aa7c454bbf94931b6b5593bf',ramdisk_id='',reservation_id='r-0bgvf9j1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-947401316',owner_user_name='tempest-VolumesAdminNegativeTest-947401316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:00:04Z,user_data=None,user_id='3e1ffe2f879f4c049b6c28d3a9623d14',uuid=81690e5b-0bcc-4e7c-87b6-e51a30571888,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97015895-15bd-401e-aa52-776f82605bc4", "address": "fa:16:3e:88:19:31", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97015895-15", "ovs_interfaceid": "97015895-15bd-401e-aa52-776f82605bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:01:52 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Converting VIF {"id": "97015895-15bd-401e-aa52-776f82605bc4", "address": "fa:16:3e:88:19:31", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97015895-15", "ovs_interfaceid": "97015895-15bd-401e-aa52-776f82605bc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:01:52 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:19:31,bridge_name='br-int',has_traffic_filtering=True,id=97015895-15bd-401e-aa52-776f82605bc4,network=Network(99569b6e-2d6c-4e03-9971-462e962f316f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97015895-15') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:01:52 user nova-compute[71692]: DEBUG os_vif [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:19:31,bridge_name='br-int',has_traffic_filtering=True,id=97015895-15bd-401e-aa52-776f82605bc4,network=Network(99569b6e-2d6c-4e03-9971-462e962f316f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97015895-15') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:01:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97015895-15, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:01:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:01:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:52 user nova-compute[71692]: INFO os_vif [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:19:31,bridge_name='br-int',has_traffic_filtering=True,id=97015895-15bd-401e-aa52-776f82605bc4,network=Network(99569b6e-2d6c-4e03-9971-462e962f316f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97015895-15')
Apr 13 19:01:52 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Deleting instance files /opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888_del
Apr 13 19:01:52 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Deletion of /opt/stack/data/nova/instances/81690e5b-0bcc-4e7c-87b6-e51a30571888_del complete
Apr 13 19:01:52 user nova-compute[71692]: INFO nova.compute.manager [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 13 19:01:52 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:01:52 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:01:52 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:01:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:01:53 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Took 0.75 seconds to deallocate network for instance.
Apr 13 19:01:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-91035c19-8b90-41cc-ab17-02c5ee5c037e req-613fca1e-1315-442f-ab37-3ae60ef0d1c6 service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Received event network-vif-deleted-97015895-15bd-401e-aa52-776f82605bc4 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:53 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Deleted allocations for instance 81690e5b-0bcc-4e7c-87b6-e51a30571888
Apr 13 19:01:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c7780434-6ab8-47d9-82c9-7c14232d5bd7 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "81690e5b-0bcc-4e7c-87b6-e51a30571888" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.415s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Received event network-vif-plugged-97015895-15bd-401e-aa52-776f82605bc4 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] Acquiring lock "81690e5b-0bcc-4e7c-87b6-e51a30571888-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] Lock "81690e5b-0bcc-4e7c-87b6-e51a30571888-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] Lock "81690e5b-0bcc-4e7c-87b6-e51a30571888-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] No waiting events found dispatching network-vif-plugged-97015895-15bd-401e-aa52-776f82605bc4 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:01:53 user nova-compute[71692]: WARNING nova.compute.manager [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Received unexpected event network-vif-plugged-97015895-15bd-401e-aa52-776f82605bc4 for instance with vm_state deleted and task_state None.
Apr 13 19:01:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received event network-vif-plugged-b5d1f04b-5691-4b8b-a52c-d54bdb160292 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] Acquiring lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] No waiting events found dispatching network-vif-plugged-b5d1f04b-5691-4b8b-a52c-d54bdb160292 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:01:53 user nova-compute[71692]: WARNING nova.compute.manager [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received unexpected event network-vif-plugged-b5d1f04b-5691-4b8b-a52c-d54bdb160292 for instance with vm_state building and task_state spawning.
Apr 13 19:01:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received event network-vif-plugged-b5d1f04b-5691-4b8b-a52c-d54bdb160292 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] Acquiring lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] No waiting events found dispatching network-vif-plugged-b5d1f04b-5691-4b8b-a52c-d54bdb160292 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:01:53 user nova-compute[71692]: WARNING nova.compute.manager [req-77535aab-3678-4a82-9098-fb2e931144bd req-83940fa7-a5bd-4728-8494-42df03e77968 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received unexpected event network-vif-plugged-b5d1f04b-5691-4b8b-a52c-d54bdb160292 for instance with vm_state building and task_state spawning.
Apr 13 19:01:55 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412515.0361865, 20edda40-d5dd-4c56-9c5d-023cfd330c8e => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:01:55 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] VM Resumed (Lifecycle Event)
Apr 13 19:01:55 user nova-compute[71692]: DEBUG nova.compute.manager [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:01:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:01:55 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Instance spawned successfully.
Apr 13 19:01:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:01:55 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:01:55 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:01:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:01:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:01:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:01:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:01:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:01:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:01:55 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:01:55 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412515.037559, 20edda40-d5dd-4c56-9c5d-023cfd330c8e => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:01:55 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] VM Started (Lifecycle Event)
Apr 13 19:01:55 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:01:55 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:01:55 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:01:55 user nova-compute[71692]: INFO nova.compute.manager [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Took 6.47 seconds to spawn the instance on the hypervisor.
Apr 13 19:01:55 user nova-compute[71692]: DEBUG nova.compute.manager [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:01:55 user nova-compute[71692]: INFO nova.compute.manager [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Took 7.25 seconds to build instance.
Apr 13 19:01:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-18fa5459-8401-4ea8-b155-a373aab6f910 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.337s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:01:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:01:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:07 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412512.305728, 81690e5b-0bcc-4e7c-87b6-e51a30571888 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:02:07 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] VM Stopped (Lifecycle Event)
Apr 13 19:02:07 user nova-compute[71692]: DEBUG nova.compute.manager [None req-5c594f73-ec10-428b-93b7-67cdde70dc12 None None] [instance: 81690e5b-0bcc-4e7c-87b6-e51a30571888] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:02:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:02:19 user nova-compute[71692]: INFO nova.compute.manager [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Detaching volume e0036a0d-e82a-4dee-b536-e4252af1ca02
Apr 13 19:02:19 user nova-compute[71692]: INFO nova.virt.block_device [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Attempting to driver detach volume e0036a0d-e82a-4dee-b536-e4252af1ca02 from mountpoint /dev/vdb
Apr 13 19:02:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Attempting to detach device vdb from instance a15c1b5e-1769-490a-b81f-09333cd4a227 from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:02:19 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:02:19 user nova-compute[71692]:   <source dev="/dev/sdb"/>
Apr 13 19:02:19 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:02:19 user nova-compute[71692]:   <serial>e0036a0d-e82a-4dee-b536-e4252af1ca02</serial>
Apr 13 19:02:19 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 19:02:19 user nova-compute[71692]: </disk>
Apr 13 19:02:19 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:02:19 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Successfully detached device vdb from instance a15c1b5e-1769-490a-b81f-09333cd4a227 from the persistent domain config.
Apr 13 19:02:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a15c1b5e-1769-490a-b81f-09333cd4a227 from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:02:19 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:02:19 user nova-compute[71692]:   <source dev="/dev/sdb"/>
Apr 13 19:02:19 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:02:19 user nova-compute[71692]:   <serial>e0036a0d-e82a-4dee-b536-e4252af1ca02</serial>
Apr 13 19:02:19 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 19:02:19 user nova-compute[71692]: </disk>
Apr 13 19:02:19 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681412539.813501, a15c1b5e-1769-490a-b81f-09333cd4a227 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:02:19 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Successfully detached device vdb from instance a15c1b5e-1769-490a-b81f-09333cd4a227 from the live domain config.
Apr 13 19:02:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tmIMbCua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:02:19 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:02:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7110ab-29f2-4cfd-a613-5b2208402f9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:02:19 user nova-compute[71692]: No targets found.
Apr 13 19:02:19 user nova-compute[71692]: iSNS:
Apr 13 19:02:19 user nova-compute[71692]: No targets found.
Apr 13 19:02:19 user nova-compute[71692]: STATIC:
Apr 13 19:02:19 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88
Apr 13 19:02:19 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:02:19 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:02:19 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02
Apr 13 19:02:19 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:02:19 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:02:19 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9
Apr 13 19:02:19 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:02:19 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:02:19 user nova-compute[71692]: FIRMWARE:
Apr 13 19:02:19 user nova-compute[71692]: No targets found.
Apr 13 19:02:19 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:02:19 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:02:19 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae02f357-1243-4d88-9508-74c37e4bb4cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7935d6b4-cbf4-48bd-a03e-65fc3652a7b9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:02:19 user nova-compute[71692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 (non-flash)
Apr 13 19:02:19 user nova-compute[71692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)
Apr 13 19:02:19 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 (non-flash)
Apr 13 19:02:19 user nova-compute[71692]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 (non-flash)
Apr 13 19:02:19 user nova-compute[71692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)
Apr 13 19:02:19 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc25ad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02'): ({'sdb'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Removing single pathed devices sdb {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aec8f0c-dff0-4e11-97df-7a817b8d3e12]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb3e7e8-203e-4b52-bad6-571672003956]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Flushing IO for device /dev/sdb {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c432ca3c-887f-4908-877d-7d2e50238beb]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:02:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e00ce0-36b5-47aa-9230-f2d32d034b46]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e106525a-2e3c-4800-bf4b-d0d2b5e0aa3e]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22e3445-938e-441c-9bec-223109f58b11]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02, portal: 172.16.0.220,3260]
Apr 13 19:02:20 user nova-compute[71692]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02, portal: 172.16.0.220,3260] successful.
Apr 13 19:02:20 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0036a0d-e82a-4dee-b536-e4252af1ca02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7bef87-0bdd-4e63-8a74-e7a8c62edc77]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] <== disconnect_volume: return (316ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'flavor' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:02:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ee3147ad-c32d-4db5-b8b7-e928853e0f19 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.674s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:02:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f1ea8aba-5ca4-4c23-8afb-d3711c29d19a tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:02:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f1ea8aba-5ca4-4c23-8afb-d3711c29d19a tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:02:21 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f1ea8aba-5ca4-4c23-8afb-d3711c29d19a tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:02:21 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f1ea8aba-5ca4-4c23-8afb-d3711c29d19a tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71692) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 13 19:02:21 user nova-compute[71692]: DEBUG nova.objects.instance [None req-f1ea8aba-5ca4-4c23-8afb-d3711c29d19a tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'flavor' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:02:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:21 user nova-compute[71692]: DEBUG nova.compute.manager [req-5a7099a8-1411-41e9-9c5c-4fbeae4ae555 req-f815565e-abe4-4f18-8490-d81d7f45db20 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received event network-vif-unplugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:02:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5a7099a8-1411-41e9-9c5c-4fbeae4ae555 req-f815565e-abe4-4f18-8490-d81d7f45db20 service nova] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:02:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5a7099a8-1411-41e9-9c5c-4fbeae4ae555 req-f815565e-abe4-4f18-8490-d81d7f45db20 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:02:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5a7099a8-1411-41e9-9c5c-4fbeae4ae555 req-f815565e-abe4-4f18-8490-d81d7f45db20 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:02:21 user nova-compute[71692]: DEBUG nova.compute.manager [req-5a7099a8-1411-41e9-9c5c-4fbeae4ae555 req-f815565e-abe4-4f18-8490-d81d7f45db20 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] No waiting events found dispatching network-vif-unplugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:02:21 user nova-compute[71692]: WARNING nova.compute.manager [req-5a7099a8-1411-41e9-9c5c-4fbeae4ae555 req-f815565e-abe4-4f18-8490-d81d7f45db20 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received unexpected event network-vif-unplugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance with vm_state active and task_state powering-off.
Apr 13 19:02:22 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Instance destroyed successfully.
Apr 13 19:02:22 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f1ea8aba-5ca4-4c23-8afb-d3711c29d19a tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:02:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f1ea8aba-5ca4-4c23-8afb-d3711c29d19a tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.836s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:02:23 user nova-compute[71692]: DEBUG nova.compute.manager [req-b5536dfd-ce3e-43bd-b028-b0e7acba41f5 req-ecda7242-e818-46ea-aa39-5e97b26bf241 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:02:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b5536dfd-ce3e-43bd-b028-b0e7acba41f5 req-ecda7242-e818-46ea-aa39-5e97b26bf241 service nova] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:02:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b5536dfd-ce3e-43bd-b028-b0e7acba41f5 req-ecda7242-e818-46ea-aa39-5e97b26bf241 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:02:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b5536dfd-ce3e-43bd-b028-b0e7acba41f5 req-ecda7242-e818-46ea-aa39-5e97b26bf241 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:02:23 user nova-compute[71692]: DEBUG nova.compute.manager [req-b5536dfd-ce3e-43bd-b028-b0e7acba41f5 req-ecda7242-e818-46ea-aa39-5e97b26bf241 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] No waiting events found dispatching network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:02:23 user nova-compute[71692]: WARNING nova.compute.manager [req-b5536dfd-ce3e-43bd-b028-b0e7acba41f5 req-ecda7242-e818-46ea-aa39-5e97b26bf241 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received unexpected event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance with vm_state stopped and task_state None.
Apr 13 19:02:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:02:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:02:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:02:25 user nova-compute[71692]: INFO nova.compute.manager [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Detaching volume 20b015e0-df81-41d5-a1fa-0e7666672a88
Apr 13 19:02:25 user nova-compute[71692]: INFO nova.virt.block_device [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Attempting to driver detach volume 20b015e0-df81-41d5-a1fa-0e7666672a88 from mountpoint /dev/vdc
Apr 13 19:02:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Attempting to detach device vdc from instance ca1b4132-15bd-4d4e-8d0c-d074824c888f from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:02:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:02:25 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:02:25 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:02:25 user nova-compute[71692]:   <target dev="vdc" bus="virtio"/>
Apr 13 19:02:25 user nova-compute[71692]:   <serial>20b015e0-df81-41d5-a1fa-0e7666672a88</serial>
Apr 13 19:02:25 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 19:02:25 user nova-compute[71692]: </disk>
Apr 13 19:02:25 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:02:25 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Successfully detached device vdc from instance ca1b4132-15bd-4d4e-8d0c-d074824c888f from the persistent domain config.
Apr 13 19:02:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ca1b4132-15bd-4d4e-8d0c-d074824c888f from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:02:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:02:25 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:02:25 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:02:25 user nova-compute[71692]:   <target dev="vdc" bus="virtio"/>
Apr 13 19:02:25 user nova-compute[71692]:   <serial>20b015e0-df81-41d5-a1fa-0e7666672a88</serial>
Apr 13 19:02:25 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 19:02:25 user nova-compute[71692]: </disk>
Apr 13 19:02:25 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681412546.077296, ca1b4132-15bd-4d4e-8d0c-d074824c888f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ca1b4132-15bd-4d4e-8d0c-d074824c888f {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:02:26 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Successfully detached device vdc from instance ca1b4132-15bd-4d4e-8d0c-d074824c888f from the live domain config.
Apr 13 19:02:26 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Obkflcdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:02:26 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[902832d2-db20-4266-8c57-d738107faf42]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:02:26 user nova-compute[71692]: No targets found.
Apr 13 19:02:26 user nova-compute[71692]: iSNS:
Apr 13 19:02:26 user nova-compute[71692]: No targets found.
Apr 13 19:02:26 user nova-compute[71692]: STATIC:
Apr 13 19:02:26 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88
Apr 13 19:02:26 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:02:26 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:02:26 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9
Apr 13 19:02:26 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:02:26 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:02:26 user nova-compute[71692]: FIRMWARE:
Apr 13 19:02:26 user nova-compute[71692]: No targets found.
Apr 13 19:02:26 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:02:26 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:02:26 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97e77dc-bfb1-432f-bb54-c8bda1e56610]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0307457-88e1-4c4e-a2b5-42fae37ade44]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 (non-flash)
Apr 13 19:02:26 user nova-compute[71692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)
Apr 13 19:02:26 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 (non-flash)
Apr 13 19:02:26 user nova-compute[71692]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)
Apr 13 19:02:26 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc290160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88'): ({'sdc'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Removing single pathed devices sdc {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4036eeda-e5f7-41a0-8358-384808bcb32f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3401bf01-0c8c-40ee-8480-f258c6e18d89]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Flushing IO for device /dev/sdc {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c11db8b-12f5-4467-819e-083a514b5ba4]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b79fdd-ce47-4658-986f-85a600e85dd1]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1864631c-d0e8-488a-8cf3-6a82e1fcb421]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47a50a1-2a3b-4f69-8e72-4c2e896c98ef]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88, portal: 172.16.0.220,3260]
Apr 13 19:02:26 user nova-compute[71692]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88, portal: 172.16.0.220,3260] successful.
Apr 13 19:02:26 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b015e0-df81-41d5-a1fa-0e7666672a88 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[94704181-e791-42c6-9071-eddce2bc5fcf]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] <== disconnect_volume: return (290ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:02:26 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:02:27 user nova-compute[71692]: DEBUG nova.objects.instance [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'flavor' on Instance uuid ca1b4132-15bd-4d4e-8d0c-d074824c888f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:02:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23a3119d-f54b-402d-8bfd-278c9994aaef tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.678s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:02:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:30 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:02:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:31 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:02:31 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:02:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:33 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:02:33 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:02:33 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:02:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:02:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:02:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:02:33 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:02:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:02:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:02:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:02:35 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:02:35 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:02:35 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8207MB free_disk=26.335620880126953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:02:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:02:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance a15c1b5e-1769-490a-b81f-09333cd4a227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance f17525a6-e377-4b33-85cd-88a7aaf4569a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 106da0b9-c823-4f26-874c-53f8ad235e61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance ca1b4132-15bd-4d4e-8d0c-d074824c888f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 33b4d519-a2df-4278-afbc-4ce7637b04ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing inventories for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating ProviderTree inventory for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating inventory in ProviderTree for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing aggregate associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, aggregates: None {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing trait associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.747s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] There are 0 instances to clean {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:02:36 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 19:02:37 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412542.2841392, a15c1b5e-1769-490a-b81f-09333cd4a227 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:02:37 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] VM Stopped (Lifecycle Event)
Apr 13 19:02:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-86028600-5ad1-4e0e-8931-72abcb771d9e None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:02:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-86028600-5ad1-4e0e-8931-72abcb771d9e None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:02:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:37 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:02:37 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:02:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:02:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Didn't find any instances for network info cache update. {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 19:02:37 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:02:37 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:02:37 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:02:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "106da0b9-c823-4f26-874c-53f8ad235e61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "106da0b9-c823-4f26-874c-53f8ad235e61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "106da0b9-c823-4f26-874c-53f8ad235e61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "106da0b9-c823-4f26-874c-53f8ad235e61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "106da0b9-c823-4f26-874c-53f8ad235e61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:02:44 user nova-compute[71692]: INFO nova.compute.manager [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Terminating instance
Apr 13 19:02:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-c4c0992f-8dd1-421c-ab50-111cf0b0a2bc req-975c77a8-8b5d-4268-a0ed-0f9f37acd69d service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Received event network-vif-unplugged-8638d612-5f79-496f-8be2-db6706c14211 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c4c0992f-8dd1-421c-ab50-111cf0b0a2bc req-975c77a8-8b5d-4268-a0ed-0f9f37acd69d service nova] Acquiring lock "106da0b9-c823-4f26-874c-53f8ad235e61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c4c0992f-8dd1-421c-ab50-111cf0b0a2bc req-975c77a8-8b5d-4268-a0ed-0f9f37acd69d service nova] Lock "106da0b9-c823-4f26-874c-53f8ad235e61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c4c0992f-8dd1-421c-ab50-111cf0b0a2bc req-975c77a8-8b5d-4268-a0ed-0f9f37acd69d service nova] Lock "106da0b9-c823-4f26-874c-53f8ad235e61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-c4c0992f-8dd1-421c-ab50-111cf0b0a2bc req-975c77a8-8b5d-4268-a0ed-0f9f37acd69d service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] No waiting events found dispatching network-vif-unplugged-8638d612-5f79-496f-8be2-db6706c14211 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-c4c0992f-8dd1-421c-ab50-111cf0b0a2bc req-975c77a8-8b5d-4268-a0ed-0f9f37acd69d service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Received event network-vif-unplugged-8638d612-5f79-496f-8be2-db6706c14211 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:02:44 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Instance destroyed successfully.
Apr 13 19:02:44 user nova-compute[71692]: DEBUG nova.objects.instance [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lazy-loading 'resources' on Instance uuid 106da0b9-c823-4f26-874c-53f8ad235e61 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:57:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-970620856',display_name='tempest-VolumesAdminNegativeTest-server-970620856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-970620856',id=6,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNx53/4TAraZymj7hPrAueoIiB2h+tK9tJDIWTVO4FAoZl6flYUlpNu57v9Udep5R3j5i9IphipgPVjtpSkbuoKv5VddMP6Q71wMlIc9GvORV54fC9iVQJ3MPfVXY9S2Ow==',key_name='tempest-keypair-2099795213',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:57:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d708f05aa7c454bbf94931b6b5593bf',ramdisk_id='',reservation_id='r-owrg3nbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-947401316',owner_user_name='tempest-VolumesAdminNegativeTest-947401316-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:57:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3e1ffe2f879f4c049b6c28d3a9623d14',uuid=106da0b9-c823-4f26-874c-53f8ad235e61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8638d612-5f79-496f-8be2-db6706c14211", "address": "fa:16:3e:c4:f2:9f", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8638d612-5f", "ovs_interfaceid": "8638d612-5f79-496f-8be2-db6706c14211", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Converting VIF {"id": "8638d612-5f79-496f-8be2-db6706c14211", "address": "fa:16:3e:c4:f2:9f", "network": {"id": "99569b6e-2d6c-4e03-9971-462e962f316f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2053790634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d708f05aa7c454bbf94931b6b5593bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8638d612-5f", "ovs_interfaceid": "8638d612-5f79-496f-8be2-db6706c14211", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:f2:9f,bridge_name='br-int',has_traffic_filtering=True,id=8638d612-5f79-496f-8be2-db6706c14211,network=Network(99569b6e-2d6c-4e03-9971-462e962f316f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8638d612-5f') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG os_vif [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:f2:9f,bridge_name='br-int',has_traffic_filtering=True,id=8638d612-5f79-496f-8be2-db6706c14211,network=Network(99569b6e-2d6c-4e03-9971-462e962f316f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8638d612-5f') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8638d612-5f, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:44 user nova-compute[71692]: INFO os_vif [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:f2:9f,bridge_name='br-int',has_traffic_filtering=True,id=8638d612-5f79-496f-8be2-db6706c14211,network=Network(99569b6e-2d6c-4e03-9971-462e962f316f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8638d612-5f')
Apr 13 19:02:44 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Deleting instance files /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61_del
Apr 13 19:02:44 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Deletion of /opt/stack/data/nova/instances/106da0b9-c823-4f26-874c-53f8ad235e61_del complete
Apr 13 19:02:44 user nova-compute[71692]: INFO nova.compute.manager [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 13 19:02:44 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:02:44 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:02:45 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:02:45 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Took 0.81 seconds to deallocate network for instance.
Apr 13 19:02:45 user nova-compute[71692]: DEBUG nova.compute.manager [req-af5d4c19-d835-4e8b-94dc-43a8e6741c18 req-7642a994-c301-48c2-8d3c-9cef30750537 service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Received event network-vif-deleted-8638d612-5f79-496f-8be2-db6706c14211 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:02:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:02:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:02:45 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:02:45 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:02:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:02:46 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Deleted allocations for instance 106da0b9-c823-4f26-874c-53f8ad235e61
Apr 13 19:02:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6d954dcf-c457-4d9b-9569-3c4736d2eb95 tempest-VolumesAdminNegativeTest-947401316 tempest-VolumesAdminNegativeTest-947401316-project-member] Lock "106da0b9-c823-4f26-874c-53f8ad235e61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.054s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:02:46 user nova-compute[71692]: DEBUG nova.compute.manager [req-d15c6581-2493-4bf3-b343-c4a8100d4e8e req-4af94fd5-ac50-4999-a52b-1cc68aac5baa service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Received event network-vif-plugged-8638d612-5f79-496f-8be2-db6706c14211 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:02:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d15c6581-2493-4bf3-b343-c4a8100d4e8e req-4af94fd5-ac50-4999-a52b-1cc68aac5baa service nova] Acquiring lock "106da0b9-c823-4f26-874c-53f8ad235e61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:02:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d15c6581-2493-4bf3-b343-c4a8100d4e8e req-4af94fd5-ac50-4999-a52b-1cc68aac5baa service nova] Lock "106da0b9-c823-4f26-874c-53f8ad235e61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:02:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d15c6581-2493-4bf3-b343-c4a8100d4e8e req-4af94fd5-ac50-4999-a52b-1cc68aac5baa service nova] Lock "106da0b9-c823-4f26-874c-53f8ad235e61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:02:46 user nova-compute[71692]: DEBUG nova.compute.manager [req-d15c6581-2493-4bf3-b343-c4a8100d4e8e req-4af94fd5-ac50-4999-a52b-1cc68aac5baa service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] No waiting events found dispatching network-vif-plugged-8638d612-5f79-496f-8be2-db6706c14211 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:02:46 user nova-compute[71692]: WARNING nova.compute.manager [req-d15c6581-2493-4bf3-b343-c4a8100d4e8e req-4af94fd5-ac50-4999-a52b-1cc68aac5baa service nova] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Received unexpected event network-vif-plugged-8638d612-5f79-496f-8be2-db6706c14211 for instance with vm_state deleted and task_state None.
Apr 13 19:02:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:59 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412564.7759135, 106da0b9-c823-4f26-874c-53f8ad235e61 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:02:59 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] VM Stopped (Lifecycle Event)
Apr 13 19:02:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ccc460c5-87f7-4b88-8c02-d502ec0c3aeb None None] [instance: 106da0b9-c823-4f26-874c-53f8ad235e61] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:02:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:02:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "33b4d519-a2df-4278-afbc-4ce7637b04ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:02:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "33b4d519-a2df-4278-afbc-4ce7637b04ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:02:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "33b4d519-a2df-4278-afbc-4ce7637b04ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:02:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "33b4d519-a2df-4278-afbc-4ce7637b04ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:02:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "33b4d519-a2df-4278-afbc-4ce7637b04ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:02:59 user nova-compute[71692]: INFO nova.compute.manager [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Terminating instance
Apr 13 19:02:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-a2db8ab1-0f09-4fd3-941c-9928886f9ffd req-90676121-93ff-4b7e-9903-91c6caa96e3e service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Received event network-vif-unplugged-83a60571-08e5-4d6e-8582-5ec7c0304ec1 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a2db8ab1-0f09-4fd3-941c-9928886f9ffd req-90676121-93ff-4b7e-9903-91c6caa96e3e service nova] Acquiring lock "33b4d519-a2df-4278-afbc-4ce7637b04ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a2db8ab1-0f09-4fd3-941c-9928886f9ffd req-90676121-93ff-4b7e-9903-91c6caa96e3e service nova] Lock "33b4d519-a2df-4278-afbc-4ce7637b04ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a2db8ab1-0f09-4fd3-941c-9928886f9ffd req-90676121-93ff-4b7e-9903-91c6caa96e3e service nova] Lock "33b4d519-a2df-4278-afbc-4ce7637b04ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-a2db8ab1-0f09-4fd3-941c-9928886f9ffd req-90676121-93ff-4b7e-9903-91c6caa96e3e service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] No waiting events found dispatching network-vif-unplugged-83a60571-08e5-4d6e-8582-5ec7c0304ec1 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-a2db8ab1-0f09-4fd3-941c-9928886f9ffd req-90676121-93ff-4b7e-9903-91c6caa96e3e service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Received event network-vif-unplugged-83a60571-08e5-4d6e-8582-5ec7c0304ec1 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:00 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Instance destroyed successfully.
Apr 13 19:03:00 user nova-compute[71692]: DEBUG nova.objects.instance [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lazy-loading 'resources' on Instance uuid 33b4d519-a2df-4278-afbc-4ce7637b04ab {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:01:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1142942524',display_name='tempest-VolumesActionsTest-instance-1142942524',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1142942524',id=12,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:01:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94f74f6b4f68416ebdb496adc62a48ed',ramdisk_id='',reservation_id='r-zlq0c2nr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1911230974',owner_user_name='tempest-VolumesActionsTest-1911230974-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:01:12Z,user_data=None,user_id='d1b0d9cad8c64a8ea80420d5d8efe16f',uuid=33b4d519-a2df-4278-afbc-4ce7637b04ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "address": "fa:16:3e:a5:9d:99", "network": {"id": "2e8ff947-529b-4387-b2c5-12c423cddf70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-885275796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "94f74f6b4f68416ebdb496adc62a48ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a60571-08", "ovs_interfaceid": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Converting VIF {"id": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "address": "fa:16:3e:a5:9d:99", "network": {"id": "2e8ff947-529b-4387-b2c5-12c423cddf70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-885275796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "94f74f6b4f68416ebdb496adc62a48ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a60571-08", "ovs_interfaceid": "83a60571-08e5-4d6e-8582-5ec7c0304ec1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:9d:99,bridge_name='br-int',has_traffic_filtering=True,id=83a60571-08e5-4d6e-8582-5ec7c0304ec1,network=Network(2e8ff947-529b-4387-b2c5-12c423cddf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a60571-08') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG os_vif [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:9d:99,bridge_name='br-int',has_traffic_filtering=True,id=83a60571-08e5-4d6e-8582-5ec7c0304ec1,network=Network(2e8ff947-529b-4387-b2c5-12c423cddf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a60571-08') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83a60571-08, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:00 user nova-compute[71692]: INFO os_vif [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:9d:99,bridge_name='br-int',has_traffic_filtering=True,id=83a60571-08e5-4d6e-8582-5ec7c0304ec1,network=Network(2e8ff947-529b-4387-b2c5-12c423cddf70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a60571-08')
Apr 13 19:03:00 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Deleting instance files /opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab_del
Apr 13 19:03:00 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Deletion of /opt/stack/data/nova/instances/33b4d519-a2df-4278-afbc-4ce7637b04ab_del complete
Apr 13 19:03:00 user nova-compute[71692]: INFO nova.compute.manager [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Took 0.70 seconds to destroy the instance on the hypervisor.
Apr 13 19:03:00 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:03:00 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:03:01 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:03:01 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Took 0.50 seconds to deallocate network for instance.
Apr 13 19:03:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:01 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:03:01 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:03:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:01 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Deleted allocations for instance 33b4d519-a2df-4278-afbc-4ce7637b04ab
Apr 13 19:03:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bf3e5c19-4930-4f80-a3bd-1a7d7206d7c6 tempest-VolumesActionsTest-1911230974 tempest-VolumesActionsTest-1911230974-project-member] Lock "33b4d519-a2df-4278-afbc-4ce7637b04ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.607s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:02 user nova-compute[71692]: DEBUG nova.compute.manager [req-3ab6db52-2b33-4296-a59e-7e1c43a79ed3 req-b20d72b9-baf5-4a83-8cb8-574198841314 service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Received event network-vif-plugged-83a60571-08e5-4d6e-8582-5ec7c0304ec1 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3ab6db52-2b33-4296-a59e-7e1c43a79ed3 req-b20d72b9-baf5-4a83-8cb8-574198841314 service nova] Acquiring lock "33b4d519-a2df-4278-afbc-4ce7637b04ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3ab6db52-2b33-4296-a59e-7e1c43a79ed3 req-b20d72b9-baf5-4a83-8cb8-574198841314 service nova] Lock "33b4d519-a2df-4278-afbc-4ce7637b04ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3ab6db52-2b33-4296-a59e-7e1c43a79ed3 req-b20d72b9-baf5-4a83-8cb8-574198841314 service nova] Lock "33b4d519-a2df-4278-afbc-4ce7637b04ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:02 user nova-compute[71692]: DEBUG nova.compute.manager [req-3ab6db52-2b33-4296-a59e-7e1c43a79ed3 req-b20d72b9-baf5-4a83-8cb8-574198841314 service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] No waiting events found dispatching network-vif-plugged-83a60571-08e5-4d6e-8582-5ec7c0304ec1 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:03:02 user nova-compute[71692]: WARNING nova.compute.manager [req-3ab6db52-2b33-4296-a59e-7e1c43a79ed3 req-b20d72b9-baf5-4a83-8cb8-574198841314 service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Received unexpected event network-vif-plugged-83a60571-08e5-4d6e-8582-5ec7c0304ec1 for instance with vm_state deleted and task_state None.
Apr 13 19:03:02 user nova-compute[71692]: DEBUG nova.compute.manager [req-3ab6db52-2b33-4296-a59e-7e1c43a79ed3 req-b20d72b9-baf5-4a83-8cb8-574198841314 service nova] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Received event network-vif-deleted-83a60571-08e5-4d6e-8582-5ec7c0304ec1 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid f17525a6-e377-4b33-85cd-88a7aaf4569a {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid ca1b4132-15bd-4d4e-8d0c-d074824c888f {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid 20edda40-d5dd-4c56-9c5d-023cfd330c8e {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "f17525a6-e377-4b33-85cd-88a7aaf4569a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "f17525a6-e377-4b33-85cd-88a7aaf4569a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "f17525a6-e377-4b33-85cd-88a7aaf4569a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:15 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412580.551045, 33b4d519-a2df-4278-afbc-4ce7637b04ab => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:03:15 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] VM Stopped (Lifecycle Event)
Apr 13 19:03:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e442812d-889d-4511-bbf9-8848e29ef01b None None] [instance: 33b4d519-a2df-4278-afbc-4ce7637b04ab] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:03:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:03:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:03:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:03:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:03:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:15 user nova-compute[71692]: INFO nova.compute.manager [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Terminating instance
Apr 13 19:03:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:03:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-1dbde542-2408-4370-8249-e70bb0b66db9 req-9b1ae551-5946-47bf-a8ea-e195b7b1a0de service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received event network-vif-unplugged-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1dbde542-2408-4370-8249-e70bb0b66db9 req-9b1ae551-5946-47bf-a8ea-e195b7b1a0de service nova] Acquiring lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1dbde542-2408-4370-8249-e70bb0b66db9 req-9b1ae551-5946-47bf-a8ea-e195b7b1a0de service nova] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1dbde542-2408-4370-8249-e70bb0b66db9 req-9b1ae551-5946-47bf-a8ea-e195b7b1a0de service nova] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-1dbde542-2408-4370-8249-e70bb0b66db9 req-9b1ae551-5946-47bf-a8ea-e195b7b1a0de service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] No waiting events found dispatching network-vif-unplugged-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-1dbde542-2408-4370-8249-e70bb0b66db9 req-9b1ae551-5946-47bf-a8ea-e195b7b1a0de service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received event network-vif-unplugged-5a439b7e-d075-4d9e-9673-523b5aa356fd for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:03:16 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Instance destroyed successfully.
Apr 13 19:03:16 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'resources' on Instance uuid ca1b4132-15bd-4d4e-8d0c-d074824c888f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T18:56:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-167054456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-167054456',id=4,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMydqo7bmRL3ACZzwkGDc5E4wLELR7X8fXhb12zGOXMBXei6xirNWcHiWE3B5l9MrFe74EHnr4RXCIBAisEn3x6JzBkNkUkW7rpPbUx5zSUBeEYIWhZNJiv3ehZ9wfugA==',key_name='tempest-keypair-1219895845',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:00:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faabdcc8e61c452ab3b934b1c9501e68',ramdisk_id='',reservation_id='r-mi7i79i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1546308967',owner_user_name='tempest-AttachVolumeShelveTestJSON-1546308967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:00:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee6c76c605d54b4f84e0596b27087f0b',uuid=ca1b4132-15bd-4d4e-8d0c-d074824c888f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converting VIF {"id": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "address": "fa:16:3e:55:cb:ae", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a439b7e-d0", "ovs_interfaceid": "5a439b7e-d075-4d9e-9673-523b5aa356fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=5a439b7e-d075-4d9e-9673-523b5aa356fd,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a439b7e-d0') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG os_vif [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=5a439b7e-d075-4d9e-9673-523b5aa356fd,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a439b7e-d0') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a439b7e-d0, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:16 user nova-compute[71692]: INFO os_vif [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:cb:ae,bridge_name='br-int',has_traffic_filtering=True,id=5a439b7e-d075-4d9e-9673-523b5aa356fd,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a439b7e-d0')
Apr 13 19:03:16 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Deleting instance files /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f_del
Apr 13 19:03:16 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Deletion of /opt/stack/data/nova/instances/ca1b4132-15bd-4d4e-8d0c-d074824c888f_del complete
Apr 13 19:03:16 user nova-compute[71692]: INFO nova.compute.manager [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 13 19:03:16 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:03:16 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:03:17 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:03:17 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Took 0.75 seconds to deallocate network for instance.
Apr 13 19:03:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:17 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:03:17 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:03:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:17 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Deleted allocations for instance ca1b4132-15bd-4d4e-8d0c-d074824c888f
Apr 13 19:03:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e2d27dd0-24fb-4c6a-aff1-61a886eaba1e tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.072s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:18 user nova-compute[71692]: DEBUG nova.compute.manager [req-1a92acb4-9cb2-4f0a-8630-4bcb6f40ae9b req-698e4fa9-1019-4eee-bc69-8ba52944d4cd service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received event network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1a92acb4-9cb2-4f0a-8630-4bcb6f40ae9b req-698e4fa9-1019-4eee-bc69-8ba52944d4cd service nova] Acquiring lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1a92acb4-9cb2-4f0a-8630-4bcb6f40ae9b req-698e4fa9-1019-4eee-bc69-8ba52944d4cd service nova] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1a92acb4-9cb2-4f0a-8630-4bcb6f40ae9b req-698e4fa9-1019-4eee-bc69-8ba52944d4cd service nova] Lock "ca1b4132-15bd-4d4e-8d0c-d074824c888f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:18 user nova-compute[71692]: DEBUG nova.compute.manager [req-1a92acb4-9cb2-4f0a-8630-4bcb6f40ae9b req-698e4fa9-1019-4eee-bc69-8ba52944d4cd service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] No waiting events found dispatching network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:03:18 user nova-compute[71692]: WARNING nova.compute.manager [req-1a92acb4-9cb2-4f0a-8630-4bcb6f40ae9b req-698e4fa9-1019-4eee-bc69-8ba52944d4cd service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received unexpected event network-vif-plugged-5a439b7e-d075-4d9e-9673-523b5aa356fd for instance with vm_state deleted and task_state None.
Apr 13 19:03:18 user nova-compute[71692]: DEBUG nova.compute.manager [req-1a92acb4-9cb2-4f0a-8630-4bcb6f40ae9b req-698e4fa9-1019-4eee-bc69-8ba52944d4cd service nova] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Received event network-vif-deleted-5a439b7e-d075-4d9e-9673-523b5aa356fd {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:03:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:03:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:03:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:03:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:30 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:03:31 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:03:31 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412596.7095635, ca1b4132-15bd-4d4e-8d0c-d074824c888f => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:03:31 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] VM Stopped (Lifecycle Event)
Apr 13 19:03:31 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f9e5d3b2-eece-4b39-a675-fc4c382a2678 None None] [instance: ca1b4132-15bd-4d4e-8d0c-d074824c888f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:03:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:32 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:03:33 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:03:33 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:03:34 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:03:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:34 user nova-compute[71692]: INFO nova.compute.manager [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Detaching volume 09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9
Apr 13 19:03:34 user nova-compute[71692]: INFO nova.virt.block_device [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Attempting to driver detach volume 09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 from mountpoint /dev/vdb
Apr 13 19:03:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Attempting to detach device vdb from instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:03:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:03:34 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:03:34 user nova-compute[71692]:   <source dev="/dev/sdd"/>
Apr 13 19:03:34 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:03:34 user nova-compute[71692]:   <serial>09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9</serial>
Apr 13 19:03:34 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 19:03:34 user nova-compute[71692]: </disk>
Apr 13 19:03:34 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:03:34 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Successfully detached device vdb from instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 from the persistent domain config.
Apr 13 19:03:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:03:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:03:34 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:03:34 user nova-compute[71692]:   <source dev="/dev/sdd"/>
Apr 13 19:03:34 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:03:34 user nova-compute[71692]:   <serial>09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9</serial>
Apr 13 19:03:34 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 19:03:34 user nova-compute[71692]: </disk>
Apr 13 19:03:34 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681412615.0032277, b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:03:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Successfully detached device vdb from instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 from the live domain config.
Apr 13 19:03:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ojTJyDmn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:03:35 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9306cff5-5785-4ce7-b885-bbd79ae135cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:03:35 user nova-compute[71692]: No targets found.
Apr 13 19:03:35 user nova-compute[71692]: iSNS:
Apr 13 19:03:35 user nova-compute[71692]: No targets found.
Apr 13 19:03:35 user nova-compute[71692]: STATIC:
Apr 13 19:03:35 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9
Apr 13 19:03:35 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:03:35 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:03:35 user nova-compute[71692]: FIRMWARE:
Apr 13 19:03:35 user nova-compute[71692]: No targets found.
Apr 13 19:03:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:03:35 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:03:35 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efb4501-eb75-4159-8c03-e4619b0a9703]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[350cb42a-6dd3-4480-979b-f2bae4fd3179]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)
Apr 13 19:03:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 (non-flash)
Apr 13 19:03:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febd8b22170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9'): ({'sdd'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Removing single pathed devices sdd {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b79ebd-bb5c-4e36-98ca-86e5c729a51c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29063b4-5d50-48ac-9674-2a81442f3ab4]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flushing IO for device /dev/sdd {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf79e2b-b366-4ef8-b31c-40f7d05c4478]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.084s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab2c601-a07b-446b-befe-0db6b38bd3a3]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[27282213-8956-476f-9f9b-5bed8b88bd25]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a9beed-fc2b-4d73-bab4-0fc193f031b1]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9, portal: 172.16.0.220,3260]
Apr 13 19:03:35 user nova-compute[71692]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9, portal: 172.16.0.220,3260] successful.
Apr 13 19:03:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09ce5e72-70ec-4c3d-8a56-e5540d0fcdd9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce984f8f-dbe6-43f6-ba3d-7638cd2fbcf9]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== disconnect_volume: return (323ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG nova.objects.instance [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'flavor' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9e4b8bf7-3319-49e8-8f9e-0f3f65a784bf tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.697s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:36 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:03:36 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:03:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8495MB free_disk=26.392044067382812GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance a15c1b5e-1769-490a-b81f-09333cd4a227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance f17525a6-e377-4b33-85cd-88a7aaf4569a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:03:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:03:37 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:03:37 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:03:37 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:03:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:03:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:03:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 19:03:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:03:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:03:38 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:03:38 user nova-compute[71692]: DEBUG nova.objects.instance [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lazy-loading 'info_cache' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-c78131d2-9538-43ef-9428-624fe63bbc3f req-6f581ce8-74ee-4f2c-a5fc-6018237a3de5 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received event network-changed-b5d1f04b-5691-4b8b-a52c-d54bdb160292 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-c78131d2-9538-43ef-9428-624fe63bbc3f req-6f581ce8-74ee-4f2c-a5fc-6018237a3de5 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Refreshing instance network info cache due to event network-changed-b5d1f04b-5691-4b8b-a52c-d54bdb160292. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c78131d2-9538-43ef-9428-624fe63bbc3f req-6f581ce8-74ee-4f2c-a5fc-6018237a3de5 service nova] Acquiring lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c78131d2-9538-43ef-9428-624fe63bbc3f req-6f581ce8-74ee-4f2c-a5fc-6018237a3de5 service nova] Acquired lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG nova.network.neutron [req-c78131d2-9538-43ef-9428-624fe63bbc3f req-6f581ce8-74ee-4f2c-a5fc-6018237a3de5 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Refreshing network info cache for port b5d1f04b-5691-4b8b-a52c-d54bdb160292 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Updating instance_info_cache with network_info: [{"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG nova.network.neutron [req-c78131d2-9538-43ef-9428-624fe63bbc3f req-6f581ce8-74ee-4f2c-a5fc-6018237a3de5 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Updated VIF entry in instance network info cache for port b5d1f04b-5691-4b8b-a52c-d54bdb160292. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG nova.network.neutron [req-c78131d2-9538-43ef-9428-624fe63bbc3f req-6f581ce8-74ee-4f2c-a5fc-6018237a3de5 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Updating instance_info_cache with network_info: [{"id": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "address": "fa:16:3e:10:5a:ab", "network": {"id": "3a84ff5b-fe4e-41eb-8cf9-6882fbec0275", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2050735987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d1f04b-56", "ovs_interfaceid": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c78131d2-9538-43ef-9428-624fe63bbc3f req-6f581ce8-74ee-4f2c-a5fc-6018237a3de5 service nova] Releasing lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "interface-20edda40-d5dd-4c56-9c5d-023cfd330c8e-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "interface-20edda40-d5dd-4c56-9c5d-023cfd330c8e-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG nova.objects.instance [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lazy-loading 'flavor' on Instance uuid 20edda40-d5dd-4c56-9c5d-023cfd330c8e {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG nova.objects.instance [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lazy-loading 'pci_requests' on Instance uuid 20edda40-d5dd-4c56-9c5d-023cfd330c8e {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG nova.network.neutron [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:03:39 user nova-compute[71692]: DEBUG nova.policy [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ff67e015f5c4480919a0bd503abedc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee3a4f50c893404b94c839e86a55b47c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:03:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Successfully created port: 821936b2-8b8b-4a71-a3cc-d5ec55666ef6 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG nova.network.neutron [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Successfully updated port: 821936b2-8b8b-4a71-a3cc-d5ec55666ef6 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquired lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG nova.network.neutron [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-fb46f912-0dec-4cde-9097-3cf9817d130c req-fdf8aaf3-fb3b-4723-a87d-8d4a286b9246 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received event network-changed-821936b2-8b8b-4a71-a3cc-d5ec55666ef6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-fb46f912-0dec-4cde-9097-3cf9817d130c req-fdf8aaf3-fb3b-4723-a87d-8d4a286b9246 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Refreshing instance network info cache due to event network-changed-821936b2-8b8b-4a71-a3cc-d5ec55666ef6. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-fb46f912-0dec-4cde-9097-3cf9817d130c req-fdf8aaf3-fb3b-4723-a87d-8d4a286b9246 service nova] Acquiring lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG nova.network.neutron [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Updating instance_info_cache with network_info: [{"id": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "address": "fa:16:3e:10:5a:ab", "network": {"id": "3a84ff5b-fe4e-41eb-8cf9-6882fbec0275", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2050735987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d1f04b-56", "ovs_interfaceid": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "address": "fa:16:3e:0e:5d:a9", "network": {"id": "d13e7a17-c450-4282-94dd-97197029d1ea", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1682805641", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821936b2-8b", "ovs_interfaceid": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Releasing lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-fb46f912-0dec-4cde-9097-3cf9817d130c req-fdf8aaf3-fb3b-4723-a87d-8d4a286b9246 service nova] Acquired lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG nova.network.neutron [req-fb46f912-0dec-4cde-9097-3cf9817d130c req-fdf8aaf3-fb3b-4723-a87d-8d4a286b9246 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Refreshing network info cache for port 821936b2-8b8b-4a71-a3cc-d5ec55666ef6 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-266550598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-266550598',id=13,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANNcqbVyx2+AlA6pJ67iCyDqokC0vj/8HKOcvYaotnci2ghezOK0wR9sJjzbtG6QMuvPDsNIPT54X8tzc1iHMAgDLsmrG5h7nHcBGX8mEcxODCqL7xCBPS67OL15k/VWg==',key_name='tempest-keypair-883887520',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:01:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ee3a4f50c893404b94c839e86a55b47c',ramdisk_id='',reservation_id='r-ulgl580f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1514135387',owner_user_name='tempest-TaggedAttachmentsTest-1514135387-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:01:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ff67e015f5c4480919a0bd503abedc3',uuid=20edda40-d5dd-4c56-9c5d-023cfd330c8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "address": "fa:16:3e:0e:5d:a9", "network": {"id": "d13e7a17-c450-4282-94dd-97197029d1ea", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1682805641", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821936b2-8b", "ovs_interfaceid": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Converting VIF {"id": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "address": "fa:16:3e:0e:5d:a9", "network": {"id": "d13e7a17-c450-4282-94dd-97197029d1ea", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1682805641", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821936b2-8b", "ovs_interfaceid": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5d:a9,bridge_name='br-int',has_traffic_filtering=True,id=821936b2-8b8b-4a71-a3cc-d5ec55666ef6,network=Network(d13e7a17-c450-4282-94dd-97197029d1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap821936b2-8b') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG os_vif [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5d:a9,bridge_name='br-int',has_traffic_filtering=True,id=821936b2-8b8b-4a71-a3cc-d5ec55666ef6,network=Network(d13e7a17-c450-4282-94dd-97197029d1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap821936b2-8b') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap821936b2-8b, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap821936b2-8b, col_values=(('external_ids', {'iface-id': '821936b2-8b8b-4a71-a3cc-d5ec55666ef6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:5d:a9', 'vm-uuid': '20edda40-d5dd-4c56-9c5d-023cfd330c8e'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:41 user nova-compute[71692]: INFO os_vif [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5d:a9,bridge_name='br-int',has_traffic_filtering=True,id=821936b2-8b8b-4a71-a3cc-d5ec55666ef6,network=Network(d13e7a17-c450-4282-94dd-97197029d1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap821936b2-8b')
Apr 13 19:03:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-266550598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-266550598',id=13,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANNcqbVyx2+AlA6pJ67iCyDqokC0vj/8HKOcvYaotnci2ghezOK0wR9sJjzbtG6QMuvPDsNIPT54X8tzc1iHMAgDLsmrG5h7nHcBGX8mEcxODCqL7xCBPS67OL15k/VWg==',key_name='tempest-keypair-883887520',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:01:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ee3a4f50c893404b94c839e86a55b47c',ramdisk_id='',reservation_id='r-ulgl580f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1514135387',owner_user_name='tempest-TaggedAttachmentsTest-1514135387-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:01:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ff67e015f5c4480919a0bd503abedc3',uuid=20edda40-d5dd-4c56-9c5d-023cfd330c8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "address": "fa:16:3e:0e:5d:a9", "network": {"id": "d13e7a17-c450-4282-94dd-97197029d1ea", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1682805641", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821936b2-8b", "ovs_interfaceid": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Converting VIF {"id": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "address": "fa:16:3e:0e:5d:a9", "network": {"id": "d13e7a17-c450-4282-94dd-97197029d1ea", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1682805641", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821936b2-8b", "ovs_interfaceid": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5d:a9,bridge_name='br-int',has_traffic_filtering=True,id=821936b2-8b8b-4a71-a3cc-d5ec55666ef6,network=Network(d13e7a17-c450-4282-94dd-97197029d1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap821936b2-8b') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] attach device xml: <interface type="ethernet">
Apr 13 19:03:41 user nova-compute[71692]:   <mac address="fa:16:3e:0e:5d:a9"/>
Apr 13 19:03:41 user nova-compute[71692]:   <model type="virtio"/>
Apr 13 19:03:41 user nova-compute[71692]:   <mtu size="1442"/>
Apr 13 19:03:41 user nova-compute[71692]:   <target dev="tap821936b2-8b"/>
Apr 13 19:03:41 user nova-compute[71692]: </interface>
Apr 13 19:03:41 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:03:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-21f35d43-e6a0-448b-91f0-729ec568add4 req-5b489638-afda-4ba8-887b-3f6691ca5ccb service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received event network-vif-plugged-821936b2-8b8b-4a71-a3cc-d5ec55666ef6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-21f35d43-e6a0-448b-91f0-729ec568add4 req-5b489638-afda-4ba8-887b-3f6691ca5ccb service nova] Acquiring lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-21f35d43-e6a0-448b-91f0-729ec568add4 req-5b489638-afda-4ba8-887b-3f6691ca5ccb service nova] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-21f35d43-e6a0-448b-91f0-729ec568add4 req-5b489638-afda-4ba8-887b-3f6691ca5ccb service nova] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-21f35d43-e6a0-448b-91f0-729ec568add4 req-5b489638-afda-4ba8-887b-3f6691ca5ccb service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] No waiting events found dispatching network-vif-plugged-821936b2-8b8b-4a71-a3cc-d5ec55666ef6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:03:42 user nova-compute[71692]: WARNING nova.compute.manager [req-21f35d43-e6a0-448b-91f0-729ec568add4 req-5b489638-afda-4ba8-887b-3f6691ca5ccb service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received unexpected event network-vif-plugged-821936b2-8b8b-4a71-a3cc-d5ec55666ef6 for instance with vm_state active and task_state None.
Apr 13 19:03:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] No BDM found with device name hda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] No VIF found with MAC fa:16:3e:10:5a:ab, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG nova.network.neutron [req-fb46f912-0dec-4cde-9097-3cf9817d130c req-fdf8aaf3-fb3b-4723-a87d-8d4a286b9246 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Updated VIF entry in instance network info cache for port 821936b2-8b8b-4a71-a3cc-d5ec55666ef6. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG nova.network.neutron [req-fb46f912-0dec-4cde-9097-3cf9817d130c req-fdf8aaf3-fb3b-4723-a87d-8d4a286b9246 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Updating instance_info_cache with network_info: [{"id": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "address": "fa:16:3e:10:5a:ab", "network": {"id": "3a84ff5b-fe4e-41eb-8cf9-6882fbec0275", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2050735987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d1f04b-56", "ovs_interfaceid": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "address": "fa:16:3e:0e:5d:a9", "network": {"id": "d13e7a17-c450-4282-94dd-97197029d1ea", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1682805641", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821936b2-8b", "ovs_interfaceid": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:03:42 user nova-compute[71692]:   <nova:package version="0.0.0"/>
Apr 13 19:03:42 user nova-compute[71692]:   <nova:name>tempest-device-tagging-server-266550598</nova:name>
Apr 13 19:03:42 user nova-compute[71692]:   <nova:creationTime>2023-04-13 19:03:42</nova:creationTime>
Apr 13 19:03:42 user nova-compute[71692]:   <nova:flavor name="m1.nano">
Apr 13 19:03:42 user nova-compute[71692]:     <nova:memory>128</nova:memory>
Apr 13 19:03:42 user nova-compute[71692]:     <nova:disk>1</nova:disk>
Apr 13 19:03:42 user nova-compute[71692]:     <nova:swap>0</nova:swap>
Apr 13 19:03:42 user nova-compute[71692]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:03:42 user nova-compute[71692]:     <nova:vcpus>1</nova:vcpus>
Apr 13 19:03:42 user nova-compute[71692]:   </nova:flavor>
Apr 13 19:03:42 user nova-compute[71692]:   <nova:owner>
Apr 13 19:03:42 user nova-compute[71692]:     <nova:user uuid="3ff67e015f5c4480919a0bd503abedc3">tempest-TaggedAttachmentsTest-1514135387-project-member</nova:user>
Apr 13 19:03:42 user nova-compute[71692]:     <nova:project uuid="ee3a4f50c893404b94c839e86a55b47c">tempest-TaggedAttachmentsTest-1514135387</nova:project>
Apr 13 19:03:42 user nova-compute[71692]:   </nova:owner>
Apr 13 19:03:42 user nova-compute[71692]:   <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:03:42 user nova-compute[71692]:   <nova:ports>
Apr 13 19:03:42 user nova-compute[71692]:     <nova:port uuid="b5d1f04b-5691-4b8b-a52c-d54bdb160292">
Apr 13 19:03:42 user nova-compute[71692]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 19:03:42 user nova-compute[71692]:     </nova:port>
Apr 13 19:03:42 user nova-compute[71692]:     <nova:port uuid="821936b2-8b8b-4a71-a3cc-d5ec55666ef6">
Apr 13 19:03:42 user nova-compute[71692]:       <nova:ip type="fixed" address="10.10.10.95" ipVersion="4"/>
Apr 13 19:03:42 user nova-compute[71692]:     </nova:port>
Apr 13 19:03:42 user nova-compute[71692]:   </nova:ports>
Apr 13 19:03:42 user nova-compute[71692]: </nova:instance>
Apr 13 19:03:42 user nova-compute[71692]:  {{(pid=71692) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-fb46f912-0dec-4cde-9097-3cf9817d130c req-fdf8aaf3-fb3b-4723-a87d-8d4a286b9246 service nova] Releasing lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-598320ea-619c-4f9f-8859-9fa60801bb83 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "interface-20edda40-d5dd-4c56-9c5d-023cfd330c8e-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.867s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG nova.objects.instance [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lazy-loading 'flavor' on Instance uuid 20edda40-d5dd-4c56-9c5d-023cfd330c8e {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:42 user nova-compute[71692]: INFO nova.compute.manager [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Attaching volume 031127c5-d900-49a1-8792-ed5b834a387c to /dev/vdb
Apr 13 19:03:43 user nova-compute[71692]: DEBUG os_brick.utils [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93d2dfd-2d47-4f91-87d8-0edae147c23c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3b6eba-cbcd-4b6e-9a05-aee1f41669b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c527a9-dbca-4b05-b654-3f62ea5b34d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0530194-1e05-4553-91e3-d56627593372]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:03:43 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:03:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c35e0ea-9448-406f-9dd6-a2e07f6f8b4a]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG os_brick.utils [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:03:43 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Updating existing volume attachment record: a14364cc-2760-4aa4-983a-6276d90a803d {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:03:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-57988d52-293f-4d89-810c-2ca277ae1530 req-a7946c5d-f447-4c86-bbe1-34abf0774fe5 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received event network-vif-plugged-821936b2-8b8b-4a71-a3cc-d5ec55666ef6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-57988d52-293f-4d89-810c-2ca277ae1530 req-a7946c5d-f447-4c86-bbe1-34abf0774fe5 service nova] Acquiring lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-57988d52-293f-4d89-810c-2ca277ae1530 req-a7946c5d-f447-4c86-bbe1-34abf0774fe5 service nova] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-57988d52-293f-4d89-810c-2ca277ae1530 req-a7946c5d-f447-4c86-bbe1-34abf0774fe5 service nova] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-57988d52-293f-4d89-810c-2ca277ae1530 req-a7946c5d-f447-4c86-bbe1-34abf0774fe5 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] No waiting events found dispatching network-vif-plugged-821936b2-8b8b-4a71-a3cc-d5ec55666ef6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:03:44 user nova-compute[71692]: WARNING nova.compute.manager [req-57988d52-293f-4d89-810c-2ca277ae1530 req-a7946c5d-f447-4c86-bbe1-34abf0774fe5 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received unexpected event network-vif-plugged-821936b2-8b8b-4a71-a3cc-d5ec55666ef6 for instance with vm_state active and task_state None.
Apr 13 19:03:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvgPceEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:03:47 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:03:47 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:03:47 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a48859-e413-42b0-9ae0-98273c9954b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:03:47 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dbc90f-1845-4f59-9c58-2442bfb3d421]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c] added
Apr 13 19:03:47 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac9429b-c2de-463e-a45c-7ee81d482f10]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[abec824c-0ad4-49df-a6e7-92ad8c0da17b]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VvgPceEx {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VvgPceEx" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[804f69c5-acef-4c60-bfdc-3ca380413382]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VvgPceEx'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0a7fc1-67f0-4e5c-a7ec-292924892f52]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aab7b1-d3fd-4e7f-9d58-800d6d24cd0c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 19:03:47 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 19:03:47 user nova-compute[71692]:  {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:03:47 user nova-compute[71692]: WARNING os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 19:03:47 user nova-compute[71692]: 
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2919898d-61ea-4304-94e2-3ff884af48b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c, portal: 172.16.0.220,3260]
Apr 13 19:03:47 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c, portal: 172.16.0.220,3260] successful.
Apr 13 19:03:47 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f799790b-3d2e-42bf-bda8-da38a6dfd4e8]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[261cc4c9-1f88-4723-93af-b929aa3a2633]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c (non-flash)
Apr 13 19:03:47 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c (non-flash)
Apr 13 19:03:47 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[71820048-15fe-4940-8bdb-60feb2bf5e88]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:03:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvgPceEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:03:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:03:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26162653866666634', 'path': '/dev/sdb'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:03:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162653866666634', 'path': '/dev/sdb'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:03:48 user nova-compute[71692]: DEBUG nova.objects.instance [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lazy-loading 'flavor' on Instance uuid 20edda40-d5dd-4c56-9c5d-023cfd330c8e {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:03:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:03:48 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:03:48 user nova-compute[71692]:   <source dev="/dev/sdb"/>
Apr 13 19:03:48 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:03:48 user nova-compute[71692]:   <serial>031127c5-d900-49a1-8792-ed5b834a387c</serial>
Apr 13 19:03:48 user nova-compute[71692]: </disk>
Apr 13 19:03:48 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:03:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:03:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] No BDM found with device name hda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:03:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] No VIF found with MAC fa:16:3e:10:5a:ab, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:03:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-dedd6cb7-f42b-4680-8611-09cc1cb96647 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.538s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:51 user nova-compute[71692]: INFO nova.compute.manager [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Detaching volume 031127c5-d900-49a1-8792-ed5b834a387c
Apr 13 19:03:51 user nova-compute[71692]: INFO nova.virt.block_device [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Attempting to driver detach volume 031127c5-d900-49a1-8792-ed5b834a387c from mountpoint /dev/vdb
Apr 13 19:03:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Attempting to detach device vdb from instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:03:51 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:03:51 user nova-compute[71692]:   <source dev="/dev/sdb"/>
Apr 13 19:03:51 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:03:51 user nova-compute[71692]:   <serial>031127c5-d900-49a1-8792-ed5b834a387c</serial>
Apr 13 19:03:51 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 19:03:51 user nova-compute[71692]: </disk>
Apr 13 19:03:51 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:03:51 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Successfully detached device vdb from instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e from the persistent domain config.
Apr 13 19:03:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:03:51 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:03:51 user nova-compute[71692]:   <source dev="/dev/sdb"/>
Apr 13 19:03:51 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:03:51 user nova-compute[71692]:   <serial>031127c5-d900-49a1-8792-ed5b834a387c</serial>
Apr 13 19:03:51 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 19:03:51 user nova-compute[71692]: </disk>
Apr 13 19:03:51 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:03:51 user nova-compute[71692]: INFO nova.compute.claims [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Claim successful on node user
Apr 13 19:03:51 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681412631.7265117, 20edda40-d5dd-4c56-9c5d-023cfd330c8e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:03:51 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Successfully detached device vdb from instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e from the live domain config.
Apr 13 19:03:51 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VvgPceEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:03:51 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:03:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[357d9112-8753-466c-bf05-646b6bde442d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:03:51 user nova-compute[71692]: No targets found.
Apr 13 19:03:51 user nova-compute[71692]: iSNS:
Apr 13 19:03:51 user nova-compute[71692]: No targets found.
Apr 13 19:03:51 user nova-compute[71692]: STATIC:
Apr 13 19:03:51 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c
Apr 13 19:03:51 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:03:51 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:03:51 user nova-compute[71692]: FIRMWARE:
Apr 13 19:03:51 user nova-compute[71692]: No targets found.
Apr 13 19:03:51 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:03:51 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:03:51 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d489bb-5447-48a6-a55d-2dd28b1ae382]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[053ad774-2b6c-45e7-a18b-0b3b60f9ca51]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c (non-flash)
Apr 13 19:03:51 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c (non-flash)
Apr 13 19:03:51 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc143250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c'): ({'sdb'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Removing single pathed devices sdb {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:03:51 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8722225c-9c37-4ea2-b307-2d1732c6d2c9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb0dd24-6f99-459c-9fc0-83a41a96acd3]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Flushing IO for device /dev/sdb {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ca2e23-9985-4bd7-a986-e203b7a9df2e]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3260d502-a5e7-48e8-80e9-e2a265563093]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG nova.policy [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6ee2da-3934-411f-a6d2-8ccb886a4369]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:03:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:03:52 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Creating image(s)
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "/opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "/opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "/opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1dedaa-8eaf-45b6-b68f-de8c34fa82a6]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c, portal: 172.16.0.220,3260]
Apr 13 19:03:52 user nova-compute[71692]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c, portal: 172.16.0.220,3260] successful.
Apr 13 19:03:52 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:031127c5-d900-49a1-8792-ed5b834a387c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d106d4-f2f7-458f-bf5f-d4a613ca3d26]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "59d7b86a-c723-4255-827e-2f6a641239df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "59d7b86a-c723-4255-827e-2f6a641239df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] <== disconnect_volume: return (336ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:03:52 user nova-compute[71692]: INFO nova.compute.claims [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Claim successful on node user
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk 1073741824" returned: 0 in 0.046s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Successfully created port: 0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Cannot resize image /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'migration_context' on Instance uuid 29eeca99-f237-49d9-9c7d-5c5b7ff2892f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Ensure instance console log exists: /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:03:52 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.policy [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:03:52 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Creating image(s)
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "/opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "/opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "/opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:52 user nova-compute[71692]: DEBUG nova.objects.instance [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lazy-loading 'flavor' on Instance uuid 20edda40-d5dd-4c56-9c5d-023cfd330c8e {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-eb18c10b-fbb4-4321-95d1-29ae3c280452 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.893s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.159s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.150s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk 1073741824" returned: 0 in 0.052s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Successfully updated port: 0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquired lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-013d5d1f-93b1-41fb-add7-e0d9a3bf3285 req-1fdfe51a-b486-43dc-8d61-628534c521ba service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received event network-changed-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-013d5d1f-93b1-41fb-add7-e0d9a3bf3285 req-1fdfe51a-b486-43dc-8d61-628534c521ba service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Refreshing instance network info cache due to event network-changed-0e8742b4-c86f-4294-9d67-8756f74a5b81. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-013d5d1f-93b1-41fb-add7-e0d9a3bf3285 req-1fdfe51a-b486-43dc-8d61-628534c521ba service nova] Acquiring lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "interface-20edda40-d5dd-4c56-9c5d-023cfd330c8e-821936b2-8b8b-4a71-a3cc-d5ec55666ef6" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "interface-20edda40-d5dd-4c56-9c5d-023cfd330c8e-821936b2-8b8b-4a71-a3cc-d5ec55666ef6" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.165s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.objects.instance [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lazy-loading 'flavor' on Instance uuid 20edda40-d5dd-4c56-9c5d-023cfd330c8e {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-266550598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-266550598',id=13,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANNcqbVyx2+AlA6pJ67iCyDqokC0vj/8HKOcvYaotnci2ghezOK0wR9sJjzbtG6QMuvPDsNIPT54X8tzc1iHMAgDLsmrG5h7nHcBGX8mEcxODCqL7xCBPS67OL15k/VWg==',key_name='tempest-keypair-883887520',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:01:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee3a4f50c893404b94c839e86a55b47c',ramdisk_id='',reservation_id='r-ulgl580f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1514135387',owner_user_name='tempest-TaggedAttachmentsTest-1514135387-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:01:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ff67e015f5c4480919a0bd503abedc3',uuid=20edda40-d5dd-4c56-9c5d-023cfd330c8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "address": "fa:16:3e:0e:5d:a9", "network": {"id": "d13e7a17-c450-4282-94dd-97197029d1ea", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1682805641", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821936b2-8b", "ovs_interfaceid": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Converting VIF {"id": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "address": "fa:16:3e:0e:5d:a9", "network": {"id": "d13e7a17-c450-4282-94dd-97197029d1ea", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1682805641", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821936b2-8b", "ovs_interfaceid": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5d:a9,bridge_name='br-int',has_traffic_filtering=True,id=821936b2-8b8b-4a71-a3cc-d5ec55666ef6,network=Network(d13e7a17-c450-4282-94dd-97197029d1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap821936b2-8b') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Successfully created port: 3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:5d:a9"/><model type="virtio"/><mtu size="1442"/><target dev="tap821936b2-8b"/></interface> {{(pid=71692) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:5d:a9"/><model type="virtio"/><mtu size="1442"/><target dev="tap821936b2-8b"/></interface> {{(pid=71692) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Attempting to detach device tap821936b2-8b from instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] detach device xml: <interface type="ethernet">
Apr 13 19:03:53 user nova-compute[71692]:   <mac address="fa:16:3e:0e:5d:a9"/>
Apr 13 19:03:53 user nova-compute[71692]:   <model type="virtio"/>
Apr 13 19:03:53 user nova-compute[71692]:   <mtu size="1442"/>
Apr 13 19:03:53 user nova-compute[71692]:   <target dev="tap821936b2-8b"/>
Apr 13 19:03:53 user nova-compute[71692]: </interface>
Apr 13 19:03:53 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:5d:a9"/><model type="virtio"/><mtu size="1442"/><target dev="tap821936b2-8b"/></interface> {{(pid=71692) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0e:5d:a9"/><model type="virtio"/><mtu size="1442"/><target dev="tap821936b2-8b"/></interface>not found in domain: <domain type='kvm' id='16'>
Apr 13 19:03:53 user nova-compute[71692]:   <name>instance-0000000d</name>
Apr 13 19:03:53 user nova-compute[71692]:   <uuid>20edda40-d5dd-4c56-9c5d-023cfd330c8e</uuid>
Apr 13 19:03:53 user nova-compute[71692]:   <metadata>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:03:53 user nova-compute[71692]:   <nova:package version="0.0.0"/>
Apr 13 19:03:53 user nova-compute[71692]:   <nova:name>tempest-device-tagging-server-266550598</nova:name>
Apr 13 19:03:53 user nova-compute[71692]:   <nova:creationTime>2023-04-13 19:03:42</nova:creationTime>
Apr 13 19:03:53 user nova-compute[71692]:   <nova:flavor name="m1.nano">
Apr 13 19:03:53 user nova-compute[71692]:     <nova:memory>128</nova:memory>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:disk>1</nova:disk>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:swap>0</nova:swap>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:vcpus>1</nova:vcpus>
Apr 13 19:03:53 user nova-compute[71692]:   </nova:flavor>
Apr 13 19:03:53 user nova-compute[71692]:   <nova:owner>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:user uuid="3ff67e015f5c4480919a0bd503abedc3">tempest-TaggedAttachmentsTest-1514135387-project-member</nova:user>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:project uuid="ee3a4f50c893404b94c839e86a55b47c">tempest-TaggedAttachmentsTest-1514135387</nova:project>
Apr 13 19:03:53 user nova-compute[71692]:   </nova:owner>
Apr 13 19:03:53 user nova-compute[71692]:   <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:03:53 user nova-compute[71692]:   <nova:ports>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:port uuid="b5d1f04b-5691-4b8b-a52c-d54bdb160292">
Apr 13 19:03:53 user nova-compute[71692]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 19:03:53 user nova-compute[71692]:     </nova:port>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:port uuid="821936b2-8b8b-4a71-a3cc-d5ec55666ef6">
Apr 13 19:03:53 user nova-compute[71692]:       <nova:ip type="fixed" address="10.10.10.95" ipVersion="4"/>
Apr 13 19:03:53 user nova-compute[71692]:     </nova:port>
Apr 13 19:03:53 user nova-compute[71692]:   </nova:ports>
Apr 13 19:03:53 user nova-compute[71692]: </nova:instance>
Apr 13 19:03:53 user nova-compute[71692]:   </metadata>
Apr 13 19:03:53 user nova-compute[71692]:   <memory unit='KiB'>131072</memory>
Apr 13 19:03:53 user nova-compute[71692]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 19:03:53 user nova-compute[71692]:   <vcpu placement='static'>1</vcpu>
Apr 13 19:03:53 user nova-compute[71692]:   <resource>
Apr 13 19:03:53 user nova-compute[71692]:     <partition>/machine</partition>
Apr 13 19:03:53 user nova-compute[71692]:   </resource>
Apr 13 19:03:53 user nova-compute[71692]:   <sysinfo type='smbios'>
Apr 13 19:03:53 user nova-compute[71692]:     <system>
Apr 13 19:03:53 user nova-compute[71692]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 19:03:53 user nova-compute[71692]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 19:03:53 user nova-compute[71692]:       <entry name='version'>0.0.0</entry>
Apr 13 19:03:53 user nova-compute[71692]:       <entry name='serial'>20edda40-d5dd-4c56-9c5d-023cfd330c8e</entry>
Apr 13 19:03:53 user nova-compute[71692]:       <entry name='uuid'>20edda40-d5dd-4c56-9c5d-023cfd330c8e</entry>
Apr 13 19:03:53 user nova-compute[71692]:       <entry name='family'>Virtual Machine</entry>
Apr 13 19:03:53 user nova-compute[71692]:     </system>
Apr 13 19:03:53 user nova-compute[71692]:   </sysinfo>
Apr 13 19:03:53 user nova-compute[71692]:   <os>
Apr 13 19:03:53 user nova-compute[71692]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 19:03:53 user nova-compute[71692]:     <boot dev='hd'/>
Apr 13 19:03:53 user nova-compute[71692]:     <smbios mode='sysinfo'/>
Apr 13 19:03:53 user nova-compute[71692]:   </os>
Apr 13 19:03:53 user nova-compute[71692]:   <features>
Apr 13 19:03:53 user nova-compute[71692]:     <acpi/>
Apr 13 19:03:53 user nova-compute[71692]:     <apic/>
Apr 13 19:03:53 user nova-compute[71692]:     <vmcoreinfo state='on'/>
Apr 13 19:03:53 user nova-compute[71692]:   </features>
Apr 13 19:03:53 user nova-compute[71692]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 19:03:53 user nova-compute[71692]:     <model fallback='forbid'>Nehalem</model>
Apr 13 19:03:53 user nova-compute[71692]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 19:03:53 user nova-compute[71692]:     <feature policy='require' name='vme'/>
Apr 13 19:03:53 user nova-compute[71692]:     <feature policy='require' name='x2apic'/>
Apr 13 19:03:53 user nova-compute[71692]:     <feature policy='require' name='hypervisor'/>
Apr 13 19:03:53 user nova-compute[71692]:   </cpu>
Apr 13 19:03:53 user nova-compute[71692]:   <clock offset='utc'>
Apr 13 19:03:53 user nova-compute[71692]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 19:03:53 user nova-compute[71692]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 19:03:53 user nova-compute[71692]:     <timer name='hpet' present='no'/>
Apr 13 19:03:53 user nova-compute[71692]:   </clock>
Apr 13 19:03:53 user nova-compute[71692]:   <on_poweroff>destroy</on_poweroff>
Apr 13 19:03:53 user nova-compute[71692]:   <on_reboot>restart</on_reboot>
Apr 13 19:03:53 user nova-compute[71692]:   <on_crash>destroy</on_crash>
Apr 13 19:03:53 user nova-compute[71692]:   <devices>
Apr 13 19:03:53 user nova-compute[71692]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 19:03:53 user nova-compute[71692]:     <disk type='file' device='disk'>
Apr 13 19:03:53 user nova-compute[71692]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 19:03:53 user nova-compute[71692]:       <source file='/opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk' index='2'/>
Apr 13 19:03:53 user nova-compute[71692]:       <backingStore type='file' index='3'>
Apr 13 19:03:53 user nova-compute[71692]:         <format type='raw'/>
Apr 13 19:03:53 user nova-compute[71692]:         <source file='/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31'/>
Apr 13 19:03:53 user nova-compute[71692]:         <backingStore/>
Apr 13 19:03:53 user nova-compute[71692]:       </backingStore>
Apr 13 19:03:53 user nova-compute[71692]:       <target dev='vda' bus='virtio'/>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='virtio-disk0'/>
Apr 13 19:03:53 user nova-compute[71692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </disk>
Apr 13 19:03:53 user nova-compute[71692]:     <disk type='file' device='cdrom'>
Apr 13 19:03:53 user nova-compute[71692]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 19:03:53 user nova-compute[71692]:       <source file='/opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk.config' index='1'/>
Apr 13 19:03:53 user nova-compute[71692]:       <backingStore/>
Apr 13 19:03:53 user nova-compute[71692]:       <target dev='hda' bus='ide'/>
Apr 13 19:03:53 user nova-compute[71692]:       <readonly/>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='ide0-0-0'/>
Apr 13 19:03:53 user nova-compute[71692]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </disk>
Apr 13 19:03:53 user nova-compute[71692]:     <controller type='usb' index='0' model='none'>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='usb'/>
Apr 13 19:03:53 user nova-compute[71692]:     </controller>
Apr 13 19:03:53 user nova-compute[71692]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='pci.0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </controller>
Apr 13 19:03:53 user nova-compute[71692]:     <controller type='ide' index='0'>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='ide'/>
Apr 13 19:03:53 user nova-compute[71692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 19:03:53 user nova-compute[71692]:     </controller>
Apr 13 19:03:53 user nova-compute[71692]:     <interface type='ethernet'>
Apr 13 19:03:53 user nova-compute[71692]:       <mac address='fa:16:3e:10:5a:ab'/>
Apr 13 19:03:53 user nova-compute[71692]:       <target dev='tapb5d1f04b-56'/>
Apr 13 19:03:53 user nova-compute[71692]:       <model type='virtio'/>
Apr 13 19:03:53 user nova-compute[71692]:       <mtu size='1442'/>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='net0'/>
Apr 13 19:03:53 user nova-compute[71692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </interface>
Apr 13 19:03:53 user nova-compute[71692]:     <interface type='ethernet'>
Apr 13 19:03:53 user nova-compute[71692]:       <mac address='fa:16:3e:0e:5d:a9'/>
Apr 13 19:03:53 user nova-compute[71692]:       <target dev='tap821936b2-8b'/>
Apr 13 19:03:53 user nova-compute[71692]:       <model type='virtio'/>
Apr 13 19:03:53 user nova-compute[71692]:       <mtu size='1442'/>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='net1'/>
Apr 13 19:03:53 user nova-compute[71692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </interface>
Apr 13 19:03:53 user nova-compute[71692]:     <serial type='pty'>
Apr 13 19:03:53 user nova-compute[71692]:       <source path='/dev/pts/2'/>
Apr 13 19:03:53 user nova-compute[71692]:       <log file='/opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/console.log' append='off'/>
Apr 13 19:03:53 user nova-compute[71692]:       <target type='isa-serial' port='0'>
Apr 13 19:03:53 user nova-compute[71692]:         <model name='isa-serial'/>
Apr 13 19:03:53 user nova-compute[71692]:       </target>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='serial0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </serial>
Apr 13 19:03:53 user nova-compute[71692]:     <console type='pty' tty='/dev/pts/2'>
Apr 13 19:03:53 user nova-compute[71692]:       <source path='/dev/pts/2'/>
Apr 13 19:03:53 user nova-compute[71692]:       <log file='/opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/console.log' append='off'/>
Apr 13 19:03:53 user nova-compute[71692]:       <target type='serial' port='0'/>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='serial0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </console>
Apr 13 19:03:53 user nova-compute[71692]:     <input type='mouse' bus='ps2'>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='input0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </input>
Apr 13 19:03:53 user nova-compute[71692]:     <input type='keyboard' bus='ps2'>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='input1'/>
Apr 13 19:03:53 user nova-compute[71692]:     </input>
Apr 13 19:03:53 user nova-compute[71692]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 13 19:03:53 user nova-compute[71692]:       <listen type='address' address='0.0.0.0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </graphics>
Apr 13 19:03:53 user nova-compute[71692]:     <audio id='1' type='none'/>
Apr 13 19:03:53 user nova-compute[71692]:     <video>
Apr 13 19:03:53 user nova-compute[71692]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='video0'/>
Apr 13 19:03:53 user nova-compute[71692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </video>
Apr 13 19:03:53 user nova-compute[71692]:     <memballoon model='virtio'>
Apr 13 19:03:53 user nova-compute[71692]:       <stats period='10'/>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='balloon0'/>
Apr 13 19:03:53 user nova-compute[71692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </memballoon>
Apr 13 19:03:53 user nova-compute[71692]:     <rng model='virtio'>
Apr 13 19:03:53 user nova-compute[71692]:       <backend model='random'>/dev/urandom</backend>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='rng0'/>
Apr 13 19:03:53 user nova-compute[71692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </rng>
Apr 13 19:03:53 user nova-compute[71692]:   </devices>
Apr 13 19:03:53 user nova-compute[71692]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 19:03:53 user nova-compute[71692]:     <label>libvirt-20edda40-d5dd-4c56-9c5d-023cfd330c8e</label>
Apr 13 19:03:53 user nova-compute[71692]:     <imagelabel>libvirt-20edda40-d5dd-4c56-9c5d-023cfd330c8e</imagelabel>
Apr 13 19:03:53 user nova-compute[71692]:   </seclabel>
Apr 13 19:03:53 user nova-compute[71692]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 19:03:53 user nova-compute[71692]:     <label>+64055:+108</label>
Apr 13 19:03:53 user nova-compute[71692]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 19:03:53 user nova-compute[71692]:   </seclabel>
Apr 13 19:03:53 user nova-compute[71692]: </domain>
Apr 13 19:03:53 user nova-compute[71692]:  {{(pid=71692) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 19:03:53 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Successfully detached device tap821936b2-8b from instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e from the persistent domain config.
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] (1/8): Attempting to detach device tap821936b2-8b with device alias net1 from instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] detach device xml: <interface type="ethernet">
Apr 13 19:03:53 user nova-compute[71692]:   <mac address="fa:16:3e:0e:5d:a9"/>
Apr 13 19:03:53 user nova-compute[71692]:   <model type="virtio"/>
Apr 13 19:03:53 user nova-compute[71692]:   <mtu size="1442"/>
Apr 13 19:03:53 user nova-compute[71692]:   <target dev="tap821936b2-8b"/>
Apr 13 19:03:53 user nova-compute[71692]: </interface>
Apr 13 19:03:53 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Cannot resize image /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'migration_context' on Instance uuid 59d7b86a-c723-4255-827e-2f6a641239df {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Ensure instance console log exists: /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Updating instance_info_cache with network_info: [{"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Releasing lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Instance network_info: |[{"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-013d5d1f-93b1-41fb-add7-e0d9a3bf3285 req-1fdfe51a-b486-43dc-8d61-628534c521ba service nova] Acquired lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.network.neutron [req-013d5d1f-93b1-41fb-add7-e0d9a3bf3285 req-1fdfe51a-b486-43dc-8d61-628534c521ba service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Refreshing network info cache for port 0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Start _get_guest_xml network_info=[{"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681412633.894135, 20edda40-d5dd-4c56-9c5d-023cfd330c8e => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Start waiting for the detach event from libvirt for device tap821936b2-8b with device alias net1 for instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:0e:5d:a9"/><model type="virtio"/><mtu size="1442"/><target dev="tap821936b2-8b"/></interface> {{(pid=71692) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:0e:5d:a9"/><model type="virtio"/><mtu size="1442"/><target dev="tap821936b2-8b"/></interface>not found in domain: <domain type='kvm' id='16'>
Apr 13 19:03:53 user nova-compute[71692]:   <name>instance-0000000d</name>
Apr 13 19:03:53 user nova-compute[71692]:   <uuid>20edda40-d5dd-4c56-9c5d-023cfd330c8e</uuid>
Apr 13 19:03:53 user nova-compute[71692]:   <metadata>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:03:53 user nova-compute[71692]:   <nova:package version="0.0.0"/>
Apr 13 19:03:53 user nova-compute[71692]:   <nova:name>tempest-device-tagging-server-266550598</nova:name>
Apr 13 19:03:53 user nova-compute[71692]:   <nova:creationTime>2023-04-13 19:03:42</nova:creationTime>
Apr 13 19:03:53 user nova-compute[71692]:   <nova:flavor name="m1.nano">
Apr 13 19:03:53 user nova-compute[71692]:     <nova:memory>128</nova:memory>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:disk>1</nova:disk>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:swap>0</nova:swap>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:vcpus>1</nova:vcpus>
Apr 13 19:03:53 user nova-compute[71692]:   </nova:flavor>
Apr 13 19:03:53 user nova-compute[71692]:   <nova:owner>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:user uuid="3ff67e015f5c4480919a0bd503abedc3">tempest-TaggedAttachmentsTest-1514135387-project-member</nova:user>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:project uuid="ee3a4f50c893404b94c839e86a55b47c">tempest-TaggedAttachmentsTest-1514135387</nova:project>
Apr 13 19:03:53 user nova-compute[71692]:   </nova:owner>
Apr 13 19:03:53 user nova-compute[71692]:   <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:03:53 user nova-compute[71692]:   <nova:ports>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:port uuid="b5d1f04b-5691-4b8b-a52c-d54bdb160292">
Apr 13 19:03:53 user nova-compute[71692]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 19:03:53 user nova-compute[71692]:     </nova:port>
Apr 13 19:03:53 user nova-compute[71692]:     <nova:port uuid="821936b2-8b8b-4a71-a3cc-d5ec55666ef6">
Apr 13 19:03:53 user nova-compute[71692]:       <nova:ip type="fixed" address="10.10.10.95" ipVersion="4"/>
Apr 13 19:03:53 user nova-compute[71692]:     </nova:port>
Apr 13 19:03:53 user nova-compute[71692]:   </nova:ports>
Apr 13 19:03:53 user nova-compute[71692]: </nova:instance>
Apr 13 19:03:53 user nova-compute[71692]:   </metadata>
Apr 13 19:03:53 user nova-compute[71692]:   <memory unit='KiB'>131072</memory>
Apr 13 19:03:53 user nova-compute[71692]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 19:03:53 user nova-compute[71692]:   <vcpu placement='static'>1</vcpu>
Apr 13 19:03:53 user nova-compute[71692]:   <resource>
Apr 13 19:03:53 user nova-compute[71692]:     <partition>/machine</partition>
Apr 13 19:03:53 user nova-compute[71692]:   </resource>
Apr 13 19:03:53 user nova-compute[71692]:   <sysinfo type='smbios'>
Apr 13 19:03:53 user nova-compute[71692]:     <system>
Apr 13 19:03:53 user nova-compute[71692]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 19:03:53 user nova-compute[71692]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 19:03:53 user nova-compute[71692]:       <entry name='version'>0.0.0</entry>
Apr 13 19:03:53 user nova-compute[71692]:       <entry name='serial'>20edda40-d5dd-4c56-9c5d-023cfd330c8e</entry>
Apr 13 19:03:53 user nova-compute[71692]:       <entry name='uuid'>20edda40-d5dd-4c56-9c5d-023cfd330c8e</entry>
Apr 13 19:03:53 user nova-compute[71692]:       <entry name='family'>Virtual Machine</entry>
Apr 13 19:03:53 user nova-compute[71692]:     </system>
Apr 13 19:03:53 user nova-compute[71692]:   </sysinfo>
Apr 13 19:03:53 user nova-compute[71692]:   <os>
Apr 13 19:03:53 user nova-compute[71692]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 19:03:53 user nova-compute[71692]:     <boot dev='hd'/>
Apr 13 19:03:53 user nova-compute[71692]:     <smbios mode='sysinfo'/>
Apr 13 19:03:53 user nova-compute[71692]:   </os>
Apr 13 19:03:53 user nova-compute[71692]:   <features>
Apr 13 19:03:53 user nova-compute[71692]:     <acpi/>
Apr 13 19:03:53 user nova-compute[71692]:     <apic/>
Apr 13 19:03:53 user nova-compute[71692]:     <vmcoreinfo state='on'/>
Apr 13 19:03:53 user nova-compute[71692]:   </features>
Apr 13 19:03:53 user nova-compute[71692]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 19:03:53 user nova-compute[71692]:     <model fallback='forbid'>Nehalem</model>
Apr 13 19:03:53 user nova-compute[71692]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 19:03:53 user nova-compute[71692]:     <feature policy='require' name='vme'/>
Apr 13 19:03:53 user nova-compute[71692]:     <feature policy='require' name='x2apic'/>
Apr 13 19:03:53 user nova-compute[71692]:     <feature policy='require' name='hypervisor'/>
Apr 13 19:03:53 user nova-compute[71692]:   </cpu>
Apr 13 19:03:53 user nova-compute[71692]:   <clock offset='utc'>
Apr 13 19:03:53 user nova-compute[71692]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 19:03:53 user nova-compute[71692]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 19:03:53 user nova-compute[71692]:     <timer name='hpet' present='no'/>
Apr 13 19:03:53 user nova-compute[71692]:   </clock>
Apr 13 19:03:53 user nova-compute[71692]:   <on_poweroff>destroy</on_poweroff>
Apr 13 19:03:53 user nova-compute[71692]:   <on_reboot>restart</on_reboot>
Apr 13 19:03:53 user nova-compute[71692]:   <on_crash>destroy</on_crash>
Apr 13 19:03:53 user nova-compute[71692]:   <devices>
Apr 13 19:03:53 user nova-compute[71692]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 19:03:53 user nova-compute[71692]:     <disk type='file' device='disk'>
Apr 13 19:03:53 user nova-compute[71692]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 19:03:53 user nova-compute[71692]:       <source file='/opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk' index='2'/>
Apr 13 19:03:53 user nova-compute[71692]:       <backingStore type='file' index='3'>
Apr 13 19:03:53 user nova-compute[71692]:         <format type='raw'/>
Apr 13 19:03:53 user nova-compute[71692]:         <source file='/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31'/>
Apr 13 19:03:53 user nova-compute[71692]:         <backingStore/>
Apr 13 19:03:53 user nova-compute[71692]:       </backingStore>
Apr 13 19:03:53 user nova-compute[71692]:       <target dev='vda' bus='virtio'/>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='virtio-disk0'/>
Apr 13 19:03:53 user nova-compute[71692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </disk>
Apr 13 19:03:53 user nova-compute[71692]:     <disk type='file' device='cdrom'>
Apr 13 19:03:53 user nova-compute[71692]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 19:03:53 user nova-compute[71692]:       <source file='/opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk.config' index='1'/>
Apr 13 19:03:53 user nova-compute[71692]:       <backingStore/>
Apr 13 19:03:53 user nova-compute[71692]:       <target dev='hda' bus='ide'/>
Apr 13 19:03:53 user nova-compute[71692]:       <readonly/>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='ide0-0-0'/>
Apr 13 19:03:53 user nova-compute[71692]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </disk>
Apr 13 19:03:53 user nova-compute[71692]:     <controller type='usb' index='0' model='none'>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='usb'/>
Apr 13 19:03:53 user nova-compute[71692]:     </controller>
Apr 13 19:03:53 user nova-compute[71692]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='pci.0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </controller>
Apr 13 19:03:53 user nova-compute[71692]:     <controller type='ide' index='0'>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='ide'/>
Apr 13 19:03:53 user nova-compute[71692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 19:03:53 user nova-compute[71692]:     </controller>
Apr 13 19:03:53 user nova-compute[71692]:     <interface type='ethernet'>
Apr 13 19:03:53 user nova-compute[71692]:       <mac address='fa:16:3e:10:5a:ab'/>
Apr 13 19:03:53 user nova-compute[71692]:       <target dev='tapb5d1f04b-56'/>
Apr 13 19:03:53 user nova-compute[71692]:       <model type='virtio'/>
Apr 13 19:03:53 user nova-compute[71692]:       <mtu size='1442'/>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='net0'/>
Apr 13 19:03:53 user nova-compute[71692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </interface>
Apr 13 19:03:53 user nova-compute[71692]:     <serial type='pty'>
Apr 13 19:03:53 user nova-compute[71692]:       <source path='/dev/pts/2'/>
Apr 13 19:03:53 user nova-compute[71692]:       <log file='/opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/console.log' append='off'/>
Apr 13 19:03:53 user nova-compute[71692]:       <target type='isa-serial' port='0'>
Apr 13 19:03:53 user nova-compute[71692]:         <model name='isa-serial'/>
Apr 13 19:03:53 user nova-compute[71692]:       </target>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='serial0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </serial>
Apr 13 19:03:53 user nova-compute[71692]:     <console type='pty' tty='/dev/pts/2'>
Apr 13 19:03:53 user nova-compute[71692]:       <source path='/dev/pts/2'/>
Apr 13 19:03:53 user nova-compute[71692]:       <log file='/opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/console.log' append='off'/>
Apr 13 19:03:53 user nova-compute[71692]:       <target type='serial' port='0'/>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='serial0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </console>
Apr 13 19:03:53 user nova-compute[71692]:     <input type='mouse' bus='ps2'>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='input0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </input>
Apr 13 19:03:53 user nova-compute[71692]:     <input type='keyboard' bus='ps2'>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='input1'/>
Apr 13 19:03:53 user nova-compute[71692]:     </input>
Apr 13 19:03:53 user nova-compute[71692]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 13 19:03:53 user nova-compute[71692]:       <listen type='address' address='0.0.0.0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </graphics>
Apr 13 19:03:53 user nova-compute[71692]:     <audio id='1' type='none'/>
Apr 13 19:03:53 user nova-compute[71692]:     <video>
Apr 13 19:03:53 user nova-compute[71692]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='video0'/>
Apr 13 19:03:53 user nova-compute[71692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </video>
Apr 13 19:03:53 user nova-compute[71692]:     <memballoon model='virtio'>
Apr 13 19:03:53 user nova-compute[71692]:       <stats period='10'/>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='balloon0'/>
Apr 13 19:03:53 user nova-compute[71692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </memballoon>
Apr 13 19:03:53 user nova-compute[71692]:     <rng model='virtio'>
Apr 13 19:03:53 user nova-compute[71692]:       <backend model='random'>/dev/urandom</backend>
Apr 13 19:03:53 user nova-compute[71692]:       <alias name='rng0'/>
Apr 13 19:03:53 user nova-compute[71692]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 19:03:53 user nova-compute[71692]:     </rng>
Apr 13 19:03:53 user nova-compute[71692]:   </devices>
Apr 13 19:03:53 user nova-compute[71692]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 19:03:53 user nova-compute[71692]:     <label>libvirt-20edda40-d5dd-4c56-9c5d-023cfd330c8e</label>
Apr 13 19:03:53 user nova-compute[71692]:     <imagelabel>libvirt-20edda40-d5dd-4c56-9c5d-023cfd330c8e</imagelabel>
Apr 13 19:03:53 user nova-compute[71692]:   </seclabel>
Apr 13 19:03:53 user nova-compute[71692]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 19:03:53 user nova-compute[71692]:     <label>+64055:+108</label>
Apr 13 19:03:53 user nova-compute[71692]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 19:03:53 user nova-compute[71692]:   </seclabel>
Apr 13 19:03:53 user nova-compute[71692]: </domain>
Apr 13 19:03:53 user nova-compute[71692]:  {{(pid=71692) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 19:03:53 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Successfully detached device tap821936b2-8b from instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e from the live domain config.
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-266550598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-266550598',id=13,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANNcqbVyx2+AlA6pJ67iCyDqokC0vj/8HKOcvYaotnci2ghezOK0wR9sJjzbtG6QMuvPDsNIPT54X8tzc1iHMAgDLsmrG5h7nHcBGX8mEcxODCqL7xCBPS67OL15k/VWg==',key_name='tempest-keypair-883887520',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:01:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee3a4f50c893404b94c839e86a55b47c',ramdisk_id='',reservation_id='r-ulgl580f',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1514135387',owner_user_name='tempest-TaggedAttachmentsTest-1514135387-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:01:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ff67e015f5c4480919a0bd503abedc3',uuid=20edda40-d5dd-4c56-9c5d-023cfd330c8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "address": "fa:16:3e:0e:5d:a9", "network": {"id": "d13e7a17-c450-4282-94dd-97197029d1ea", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1682805641", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821936b2-8b", "ovs_interfaceid": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Converting VIF {"id": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "address": "fa:16:3e:0e:5d:a9", "network": {"id": "d13e7a17-c450-4282-94dd-97197029d1ea", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1682805641", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap821936b2-8b", "ovs_interfaceid": "821936b2-8b8b-4a71-a3cc-d5ec55666ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5d:a9,bridge_name='br-int',has_traffic_filtering=True,id=821936b2-8b8b-4a71-a3cc-d5ec55666ef6,network=Network(d13e7a17-c450-4282-94dd-97197029d1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap821936b2-8b') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG os_vif [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5d:a9,bridge_name='br-int',has_traffic_filtering=True,id=821936b2-8b8b-4a71-a3cc-d5ec55666ef6,network=Network(d13e7a17-c450-4282-94dd-97197029d1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap821936b2-8b') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap821936b2-8b, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:03:53 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:03:53 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:03:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-644483843',display_name='tempest-ServerRescueNegativeTestJSON-server-644483843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-644483843',id=14,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fbd7089a7e4ba8b2597fca0d8e84c8',ramdisk_id='',reservation_id='r-n2ktk0pw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1255770111',owner_user_name='tempest-ServerRescueNegativeTestJSON-1255770111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:03:52Z,user_data=None,user_id='3bebf61a7401492692f9c60adde178f7',uuid=29eeca99-f237-49d9-9c7d-5c5b7ff2892f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converting VIF {"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ae:15,bridge_name='br-int',has_traffic_filtering=True,id=0e8742b4-c86f-4294-9d67-8756f74a5b81,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8742b4-c8') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:03:53 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'pci_devices' on Instance uuid 29eeca99-f237-49d9-9c7d-5c5b7ff2892f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:54 user nova-compute[71692]: INFO os_vif [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5d:a9,bridge_name='br-int',has_traffic_filtering=True,id=821936b2-8b8b-4a71-a3cc-d5ec55666ef6,network=Network(d13e7a17-c450-4282-94dd-97197029d1ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap821936b2-8b')
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:03:54 user nova-compute[71692]:   <nova:package version="0.0.0"/>
Apr 13 19:03:54 user nova-compute[71692]:   <nova:name>tempest-device-tagging-server-266550598</nova:name>
Apr 13 19:03:54 user nova-compute[71692]:   <nova:creationTime>2023-04-13 19:03:54</nova:creationTime>
Apr 13 19:03:54 user nova-compute[71692]:   <nova:flavor name="m1.nano">
Apr 13 19:03:54 user nova-compute[71692]:     <nova:memory>128</nova:memory>
Apr 13 19:03:54 user nova-compute[71692]:     <nova:disk>1</nova:disk>
Apr 13 19:03:54 user nova-compute[71692]:     <nova:swap>0</nova:swap>
Apr 13 19:03:54 user nova-compute[71692]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:03:54 user nova-compute[71692]:     <nova:vcpus>1</nova:vcpus>
Apr 13 19:03:54 user nova-compute[71692]:   </nova:flavor>
Apr 13 19:03:54 user nova-compute[71692]:   <nova:owner>
Apr 13 19:03:54 user nova-compute[71692]:     <nova:user uuid="3ff67e015f5c4480919a0bd503abedc3">tempest-TaggedAttachmentsTest-1514135387-project-member</nova:user>
Apr 13 19:03:54 user nova-compute[71692]:     <nova:project uuid="ee3a4f50c893404b94c839e86a55b47c">tempest-TaggedAttachmentsTest-1514135387</nova:project>
Apr 13 19:03:54 user nova-compute[71692]:   </nova:owner>
Apr 13 19:03:54 user nova-compute[71692]:   <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:03:54 user nova-compute[71692]:   <nova:ports>
Apr 13 19:03:54 user nova-compute[71692]:     <nova:port uuid="b5d1f04b-5691-4b8b-a52c-d54bdb160292">
Apr 13 19:03:54 user nova-compute[71692]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 19:03:54 user nova-compute[71692]:     </nova:port>
Apr 13 19:03:54 user nova-compute[71692]:   </nova:ports>
Apr 13 19:03:54 user nova-compute[71692]: </nova:instance>
Apr 13 19:03:54 user nova-compute[71692]:  {{(pid=71692) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:03:54 user nova-compute[71692]:   <uuid>29eeca99-f237-49d9-9c7d-5c5b7ff2892f</uuid>
Apr 13 19:03:54 user nova-compute[71692]:   <name>instance-0000000e</name>
Apr 13 19:03:54 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:03:54 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:03:54 user nova-compute[71692]:   <metadata>
Apr 13 19:03:54 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:03:54 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:03:54 user nova-compute[71692]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-644483843</nova:name>
Apr 13 19:03:54 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:03:53</nova:creationTime>
Apr 13 19:03:54 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:03:54 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:03:54 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:03:54 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:03:54 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:03:54 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:03:54 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:03:54 user nova-compute[71692]:       <nova:owner>
Apr 13 19:03:54 user nova-compute[71692]:         <nova:user uuid="3bebf61a7401492692f9c60adde178f7">tempest-ServerRescueNegativeTestJSON-1255770111-project-member</nova:user>
Apr 13 19:03:54 user nova-compute[71692]:         <nova:project uuid="42fbd7089a7e4ba8b2597fca0d8e84c8">tempest-ServerRescueNegativeTestJSON-1255770111</nova:project>
Apr 13 19:03:54 user nova-compute[71692]:       </nova:owner>
Apr 13 19:03:54 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:03:54 user nova-compute[71692]:       <nova:ports>
Apr 13 19:03:54 user nova-compute[71692]:         <nova:port uuid="0e8742b4-c86f-4294-9d67-8756f74a5b81">
Apr 13 19:03:54 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 19:03:54 user nova-compute[71692]:         </nova:port>
Apr 13 19:03:54 user nova-compute[71692]:       </nova:ports>
Apr 13 19:03:54 user nova-compute[71692]:     </nova:instance>
Apr 13 19:03:54 user nova-compute[71692]:   </metadata>
Apr 13 19:03:54 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:03:54 user nova-compute[71692]:     <system>
Apr 13 19:03:54 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:03:54 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:03:54 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:03:54 user nova-compute[71692]:       <entry name="serial">29eeca99-f237-49d9-9c7d-5c5b7ff2892f</entry>
Apr 13 19:03:54 user nova-compute[71692]:       <entry name="uuid">29eeca99-f237-49d9-9c7d-5c5b7ff2892f</entry>
Apr 13 19:03:54 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:03:54 user nova-compute[71692]:     </system>
Apr 13 19:03:54 user nova-compute[71692]:   </sysinfo>
Apr 13 19:03:54 user nova-compute[71692]:   <os>
Apr 13 19:03:54 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:03:54 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:03:54 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:03:54 user nova-compute[71692]:   </os>
Apr 13 19:03:54 user nova-compute[71692]:   <features>
Apr 13 19:03:54 user nova-compute[71692]:     <acpi/>
Apr 13 19:03:54 user nova-compute[71692]:     <apic/>
Apr 13 19:03:54 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:03:54 user nova-compute[71692]:   </features>
Apr 13 19:03:54 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:03:54 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:03:54 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:03:54 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:03:54 user nova-compute[71692]:   </clock>
Apr 13 19:03:54 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:03:54 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:03:54 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:03:54 user nova-compute[71692]:   </cpu>
Apr 13 19:03:54 user nova-compute[71692]:   <devices>
Apr 13 19:03:54 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:03:54 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:03:54 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk"/>
Apr 13 19:03:54 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:03:54 user nova-compute[71692]:     </disk>
Apr 13 19:03:54 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:03:54 user nova-compute[71692]:       <mac address="fa:16:3e:d1:ae:15"/>
Apr 13 19:03:54 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:03:54 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:03:54 user nova-compute[71692]:       <target dev="tap0e8742b4-c8"/>
Apr 13 19:03:54 user nova-compute[71692]:     </interface>
Apr 13 19:03:54 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:03:54 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/console.log" append="off"/>
Apr 13 19:03:54 user nova-compute[71692]:     </serial>
Apr 13 19:03:54 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:03:54 user nova-compute[71692]:     <video>
Apr 13 19:03:54 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:03:54 user nova-compute[71692]:     </video>
Apr 13 19:03:54 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:03:54 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:03:54 user nova-compute[71692]:     </rng>
Apr 13 19:03:54 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:03:54 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:03:54 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:03:54 user nova-compute[71692]:     </memballoon>
Apr 13 19:03:54 user nova-compute[71692]:   </devices>
Apr 13 19:03:54 user nova-compute[71692]: </domain>
Apr 13 19:03:54 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:03:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-644483843',display_name='tempest-ServerRescueNegativeTestJSON-server-644483843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-644483843',id=14,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fbd7089a7e4ba8b2597fca0d8e84c8',ramdisk_id='',reservation_id='r-n2ktk0pw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1255770111',owner_user_name='tempest-ServerRescueNegativeTestJSON-1255770111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:03:52Z,user_data=None,user_id='3bebf61a7401492692f9c60adde178f7',uuid=29eeca99-f237-49d9-9c7d-5c5b7ff2892f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converting VIF {"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ae:15,bridge_name='br-int',has_traffic_filtering=True,id=0e8742b4-c86f-4294-9d67-8756f74a5b81,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8742b4-c8') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG os_vif [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ae:15,bridge_name='br-int',has_traffic_filtering=True,id=0e8742b4-c86f-4294-9d67-8756f74a5b81,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8742b4-c8') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e8742b4-c8, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0e8742b4-c8, col_values=(('external_ids', {'iface-id': '0e8742b4-c86f-4294-9d67-8756f74a5b81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:ae:15', 'vm-uuid': '29eeca99-f237-49d9-9c7d-5c5b7ff2892f'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:54 user nova-compute[71692]: INFO os_vif [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ae:15,bridge_name='br-int',has_traffic_filtering=True,id=0e8742b4-c86f-4294-9d67-8756f74a5b81,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8742b4-c8')
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-cddacf14-b58e-42d7-96ef-ae665ad906a6 req-af5b0cca-ce60-41f9-8051-268f8effc7c2 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received event network-vif-unplugged-821936b2-8b8b-4a71-a3cc-d5ec55666ef6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cddacf14-b58e-42d7-96ef-ae665ad906a6 req-af5b0cca-ce60-41f9-8051-268f8effc7c2 service nova] Acquiring lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cddacf14-b58e-42d7-96ef-ae665ad906a6 req-af5b0cca-ce60-41f9-8051-268f8effc7c2 service nova] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cddacf14-b58e-42d7-96ef-ae665ad906a6 req-af5b0cca-ce60-41f9-8051-268f8effc7c2 service nova] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-cddacf14-b58e-42d7-96ef-ae665ad906a6 req-af5b0cca-ce60-41f9-8051-268f8effc7c2 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] No waiting events found dispatching network-vif-unplugged-821936b2-8b8b-4a71-a3cc-d5ec55666ef6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:03:54 user nova-compute[71692]: WARNING nova.compute.manager [req-cddacf14-b58e-42d7-96ef-ae665ad906a6 req-af5b0cca-ce60-41f9-8051-268f8effc7c2 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received unexpected event network-vif-unplugged-821936b2-8b8b-4a71-a3cc-d5ec55666ef6 for instance with vm_state active and task_state None.
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No VIF found with MAC fa:16:3e:d1:ae:15, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Successfully updated port: 3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "refresh_cache-59d7b86a-c723-4255-827e-2f6a641239df" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquired lock "refresh_cache-59d7b86a-c723-4255-827e-2f6a641239df" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-65ff0cf4-bfdd-4ea8-9907-ad8ab9221b08 req-e6510885-702c-45a7-a4b9-3777ee77fa16 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received event network-changed-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-65ff0cf4-bfdd-4ea8-9907-ad8ab9221b08 req-e6510885-702c-45a7-a4b9-3777ee77fa16 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Refreshing instance network info cache due to event network-changed-3de4b459-2a9f-4570-80b1-dce61f40a377. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-65ff0cf4-bfdd-4ea8-9907-ad8ab9221b08 req-e6510885-702c-45a7-a4b9-3777ee77fa16 service nova] Acquiring lock "refresh_cache-59d7b86a-c723-4255-827e-2f6a641239df" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.network.neutron [req-013d5d1f-93b1-41fb-add7-e0d9a3bf3285 req-1fdfe51a-b486-43dc-8d61-628534c521ba service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Updated VIF entry in instance network info cache for port 0e8742b4-c86f-4294-9d67-8756f74a5b81. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.network.neutron [req-013d5d1f-93b1-41fb-add7-e0d9a3bf3285 req-1fdfe51a-b486-43dc-8d61-628534c521ba service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Updating instance_info_cache with network_info: [{"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-013d5d1f-93b1-41fb-add7-e0d9a3bf3285 req-1fdfe51a-b486-43dc-8d61-628534c521ba service nova] Releasing lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Updating instance_info_cache with network_info: [{"id": "3de4b459-2a9f-4570-80b1-dce61f40a377", "address": "fa:16:3e:de:c1:80", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4b459-2a", "ovs_interfaceid": "3de4b459-2a9f-4570-80b1-dce61f40a377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Releasing lock "refresh_cache-59d7b86a-c723-4255-827e-2f6a641239df" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Instance network_info: |[{"id": "3de4b459-2a9f-4570-80b1-dce61f40a377", "address": "fa:16:3e:de:c1:80", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4b459-2a", "ovs_interfaceid": "3de4b459-2a9f-4570-80b1-dce61f40a377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-65ff0cf4-bfdd-4ea8-9907-ad8ab9221b08 req-e6510885-702c-45a7-a4b9-3777ee77fa16 service nova] Acquired lock "refresh_cache-59d7b86a-c723-4255-827e-2f6a641239df" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.network.neutron [req-65ff0cf4-bfdd-4ea8-9907-ad8ab9221b08 req-e6510885-702c-45a7-a4b9-3777ee77fa16 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Refreshing network info cache for port 3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Start _get_guest_xml network_info=[{"id": "3de4b459-2a9f-4570-80b1-dce61f40a377", "address": "fa:16:3e:de:c1:80", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4b459-2a", "ovs_interfaceid": "3de4b459-2a9f-4570-80b1-dce61f40a377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:03:54 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:03:54 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:03:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1333783847',display_name='tempest-ServerRescueNegativeTestJSON-server-1333783847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1333783847',id=15,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fbd7089a7e4ba8b2597fca0d8e84c8',ramdisk_id='',reservation_id='r-4fmtejoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1255770111',owner_user_name='tempest-ServerRescueNegativeTestJSON-1255770111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:03:53Z,user_data=None,user_id='3bebf61a7401492692f9c60adde178f7',uuid=59d7b86a-c723-4255-827e-2f6a641239df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3de4b459-2a9f-4570-80b1-dce61f40a377", "address": "fa:16:3e:de:c1:80", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4b459-2a", "ovs_interfaceid": "3de4b459-2a9f-4570-80b1-dce61f40a377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converting VIF {"id": "3de4b459-2a9f-4570-80b1-dce61f40a377", "address": "fa:16:3e:de:c1:80", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4b459-2a", "ovs_interfaceid": "3de4b459-2a9f-4570-80b1-dce61f40a377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:c1:80,bridge_name='br-int',has_traffic_filtering=True,id=3de4b459-2a9f-4570-80b1-dce61f40a377,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4b459-2a') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'pci_devices' on Instance uuid 59d7b86a-c723-4255-827e-2f6a641239df {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:03:54 user nova-compute[71692]:   <uuid>59d7b86a-c723-4255-827e-2f6a641239df</uuid>
Apr 13 19:03:54 user nova-compute[71692]:   <name>instance-0000000f</name>
Apr 13 19:03:54 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:03:54 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:03:54 user nova-compute[71692]:   <metadata>
Apr 13 19:03:54 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:03:54 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:03:54 user nova-compute[71692]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1333783847</nova:name>
Apr 13 19:03:54 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:03:54</nova:creationTime>
Apr 13 19:03:54 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:03:54 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:03:54 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:03:54 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:03:54 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:03:54 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:03:54 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:03:54 user nova-compute[71692]:       <nova:owner>
Apr 13 19:03:54 user nova-compute[71692]:         <nova:user uuid="3bebf61a7401492692f9c60adde178f7">tempest-ServerRescueNegativeTestJSON-1255770111-project-member</nova:user>
Apr 13 19:03:54 user nova-compute[71692]:         <nova:project uuid="42fbd7089a7e4ba8b2597fca0d8e84c8">tempest-ServerRescueNegativeTestJSON-1255770111</nova:project>
Apr 13 19:03:54 user nova-compute[71692]:       </nova:owner>
Apr 13 19:03:54 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:03:54 user nova-compute[71692]:       <nova:ports>
Apr 13 19:03:54 user nova-compute[71692]:         <nova:port uuid="3de4b459-2a9f-4570-80b1-dce61f40a377">
Apr 13 19:03:54 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 19:03:54 user nova-compute[71692]:         </nova:port>
Apr 13 19:03:54 user nova-compute[71692]:       </nova:ports>
Apr 13 19:03:54 user nova-compute[71692]:     </nova:instance>
Apr 13 19:03:54 user nova-compute[71692]:   </metadata>
Apr 13 19:03:54 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:03:54 user nova-compute[71692]:     <system>
Apr 13 19:03:54 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:03:54 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:03:54 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:03:54 user nova-compute[71692]:       <entry name="serial">59d7b86a-c723-4255-827e-2f6a641239df</entry>
Apr 13 19:03:54 user nova-compute[71692]:       <entry name="uuid">59d7b86a-c723-4255-827e-2f6a641239df</entry>
Apr 13 19:03:54 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:03:54 user nova-compute[71692]:     </system>
Apr 13 19:03:54 user nova-compute[71692]:   </sysinfo>
Apr 13 19:03:54 user nova-compute[71692]:   <os>
Apr 13 19:03:54 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:03:54 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:03:54 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:03:54 user nova-compute[71692]:   </os>
Apr 13 19:03:54 user nova-compute[71692]:   <features>
Apr 13 19:03:54 user nova-compute[71692]:     <acpi/>
Apr 13 19:03:54 user nova-compute[71692]:     <apic/>
Apr 13 19:03:54 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:03:54 user nova-compute[71692]:   </features>
Apr 13 19:03:54 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:03:54 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:03:54 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:03:54 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:03:54 user nova-compute[71692]:   </clock>
Apr 13 19:03:54 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:03:54 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:03:54 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:03:54 user nova-compute[71692]:   </cpu>
Apr 13 19:03:54 user nova-compute[71692]:   <devices>
Apr 13 19:03:54 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:03:54 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:03:54 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk"/>
Apr 13 19:03:54 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:03:54 user nova-compute[71692]:     </disk>
Apr 13 19:03:54 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:03:54 user nova-compute[71692]:       <mac address="fa:16:3e:de:c1:80"/>
Apr 13 19:03:54 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:03:54 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:03:54 user nova-compute[71692]:       <target dev="tap3de4b459-2a"/>
Apr 13 19:03:54 user nova-compute[71692]:     </interface>
Apr 13 19:03:54 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:03:54 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/console.log" append="off"/>
Apr 13 19:03:54 user nova-compute[71692]:     </serial>
Apr 13 19:03:54 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:03:54 user nova-compute[71692]:     <video>
Apr 13 19:03:54 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:03:54 user nova-compute[71692]:     </video>
Apr 13 19:03:54 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:03:54 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:03:54 user nova-compute[71692]:     </rng>
Apr 13 19:03:54 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:03:54 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:03:54 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:03:54 user nova-compute[71692]:     </memballoon>
Apr 13 19:03:54 user nova-compute[71692]:   </devices>
Apr 13 19:03:54 user nova-compute[71692]: </domain>
Apr 13 19:03:54 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:03:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1333783847',display_name='tempest-ServerRescueNegativeTestJSON-server-1333783847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1333783847',id=15,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fbd7089a7e4ba8b2597fca0d8e84c8',ramdisk_id='',reservation_id='r-4fmtejoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1255770111',owner_user_name='tempest-ServerRescueNegativeTestJSON-1255770111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:03:53Z,user_data=None,user_id='3bebf61a7401492692f9c60adde178f7',uuid=59d7b86a-c723-4255-827e-2f6a641239df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3de4b459-2a9f-4570-80b1-dce61f40a377", "address": "fa:16:3e:de:c1:80", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4b459-2a", "ovs_interfaceid": "3de4b459-2a9f-4570-80b1-dce61f40a377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converting VIF {"id": "3de4b459-2a9f-4570-80b1-dce61f40a377", "address": "fa:16:3e:de:c1:80", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4b459-2a", "ovs_interfaceid": "3de4b459-2a9f-4570-80b1-dce61f40a377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:c1:80,bridge_name='br-int',has_traffic_filtering=True,id=3de4b459-2a9f-4570-80b1-dce61f40a377,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4b459-2a') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG os_vif [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:c1:80,bridge_name='br-int',has_traffic_filtering=True,id=3de4b459-2a9f-4570-80b1-dce61f40a377,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4b459-2a') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3de4b459-2a, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3de4b459-2a, col_values=(('external_ids', {'iface-id': '3de4b459-2a9f-4570-80b1-dce61f40a377', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:c1:80', 'vm-uuid': '59d7b86a-c723-4255-827e-2f6a641239df'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:03:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:54 user nova-compute[71692]: INFO os_vif [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:c1:80,bridge_name='br-int',has_traffic_filtering=True,id=3de4b459-2a9f-4570-80b1-dce61f40a377,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4b459-2a')
Apr 13 19:03:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:03:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquired lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:03:55 user nova-compute[71692]: DEBUG nova.network.neutron [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:03:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:03:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No VIF found with MAC fa:16:3e:de:c1:80, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:03:55 user nova-compute[71692]: INFO nova.network.neutron [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Port 821936b2-8b8b-4a71-a3cc-d5ec55666ef6 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 13 19:03:55 user nova-compute[71692]: DEBUG nova.network.neutron [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Updating instance_info_cache with network_info: [{"id": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "address": "fa:16:3e:10:5a:ab", "network": {"id": "3a84ff5b-fe4e-41eb-8cf9-6882fbec0275", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2050735987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d1f04b-56", "ovs_interfaceid": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:03:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Releasing lock "refresh_cache-20edda40-d5dd-4c56-9c5d-023cfd330c8e" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:03:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bca39486-e292-49f5-b357-1573cbf8b5d9 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "interface-20edda40-d5dd-4c56-9c5d-023cfd330c8e-821936b2-8b8b-4a71-a3cc-d5ec55666ef6" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.144s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:55 user nova-compute[71692]: DEBUG nova.network.neutron [req-65ff0cf4-bfdd-4ea8-9907-ad8ab9221b08 req-e6510885-702c-45a7-a4b9-3777ee77fa16 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Updated VIF entry in instance network info cache for port 3de4b459-2a9f-4570-80b1-dce61f40a377. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:03:55 user nova-compute[71692]: DEBUG nova.network.neutron [req-65ff0cf4-bfdd-4ea8-9907-ad8ab9221b08 req-e6510885-702c-45a7-a4b9-3777ee77fa16 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Updating instance_info_cache with network_info: [{"id": "3de4b459-2a9f-4570-80b1-dce61f40a377", "address": "fa:16:3e:de:c1:80", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4b459-2a", "ovs_interfaceid": "3de4b459-2a9f-4570-80b1-dce61f40a377", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:03:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-65ff0cf4-bfdd-4ea8-9907-ad8ab9221b08 req-e6510885-702c-45a7-a4b9-3777ee77fa16 service nova] Releasing lock "refresh_cache-59d7b86a-c723-4255-827e-2f6a641239df" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:03:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-976ee81d-fe10-4fe7-abff-c6c75938545c req-1d82eae2-548d-43af-86ca-08e81f8262fe service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-976ee81d-fe10-4fe7-abff-c6c75938545c req-1d82eae2-548d-43af-86ca-08e81f8262fe service nova] Acquiring lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-976ee81d-fe10-4fe7-abff-c6c75938545c req-1d82eae2-548d-43af-86ca-08e81f8262fe service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-976ee81d-fe10-4fe7-abff-c6c75938545c req-1d82eae2-548d-43af-86ca-08e81f8262fe service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-976ee81d-fe10-4fe7-abff-c6c75938545c req-1d82eae2-548d-43af-86ca-08e81f8262fe service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] No waiting events found dispatching network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:03:56 user nova-compute[71692]: WARNING nova.compute.manager [req-976ee81d-fe10-4fe7-abff-c6c75938545c req-1d82eae2-548d-43af-86ca-08e81f8262fe service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received unexpected event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance with vm_state building and task_state spawning.
Apr 13 19:03:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-b61cbc54-19b2-4d9c-afff-05caf3329945 req-fce32b8f-4c1f-4a1c-bad8-6d9d983f9aac service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received event network-vif-plugged-821936b2-8b8b-4a71-a3cc-d5ec55666ef6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b61cbc54-19b2-4d9c-afff-05caf3329945 req-fce32b8f-4c1f-4a1c-bad8-6d9d983f9aac service nova] Acquiring lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b61cbc54-19b2-4d9c-afff-05caf3329945 req-fce32b8f-4c1f-4a1c-bad8-6d9d983f9aac service nova] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b61cbc54-19b2-4d9c-afff-05caf3329945 req-fce32b8f-4c1f-4a1c-bad8-6d9d983f9aac service nova] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-b61cbc54-19b2-4d9c-afff-05caf3329945 req-fce32b8f-4c1f-4a1c-bad8-6d9d983f9aac service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] No waiting events found dispatching network-vif-plugged-821936b2-8b8b-4a71-a3cc-d5ec55666ef6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:03:56 user nova-compute[71692]: WARNING nova.compute.manager [req-b61cbc54-19b2-4d9c-afff-05caf3329945 req-fce32b8f-4c1f-4a1c-bad8-6d9d983f9aac service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received unexpected event network-vif-plugged-821936b2-8b8b-4a71-a3cc-d5ec55666ef6 for instance with vm_state active and task_state None.
Apr 13 19:03:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-b61cbc54-19b2-4d9c-afff-05caf3329945 req-fce32b8f-4c1f-4a1c-bad8-6d9d983f9aac service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received event network-vif-deleted-821936b2-8b8b-4a71-a3cc-d5ec55666ef6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:03:58 user nova-compute[71692]: DEBUG nova.compute.manager [req-0e584f18-92bc-4cb1-9312-65d12f9b9030 req-6387226e-738e-4fa3-884e-951efcfcd576 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0e584f18-92bc-4cb1-9312-65d12f9b9030 req-6387226e-738e-4fa3-884e-951efcfcd576 service nova] Acquiring lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0e584f18-92bc-4cb1-9312-65d12f9b9030 req-6387226e-738e-4fa3-884e-951efcfcd576 service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0e584f18-92bc-4cb1-9312-65d12f9b9030 req-6387226e-738e-4fa3-884e-951efcfcd576 service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:58 user nova-compute[71692]: DEBUG nova.compute.manager [req-0e584f18-92bc-4cb1-9312-65d12f9b9030 req-6387226e-738e-4fa3-884e-951efcfcd576 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] No waiting events found dispatching network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:03:58 user nova-compute[71692]: WARNING nova.compute.manager [req-0e584f18-92bc-4cb1-9312-65d12f9b9030 req-6387226e-738e-4fa3-884e-951efcfcd576 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received unexpected event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance with vm_state building and task_state spawning.
Apr 13 19:03:58 user nova-compute[71692]: DEBUG nova.compute.manager [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received event network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] Acquiring lock "59d7b86a-c723-4255-827e-2f6a641239df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:58 user nova-compute[71692]: DEBUG nova.compute.manager [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] No waiting events found dispatching network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:03:58 user nova-compute[71692]: WARNING nova.compute.manager [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received unexpected event network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 for instance with vm_state building and task_state spawning.
Apr 13 19:03:58 user nova-compute[71692]: DEBUG nova.compute.manager [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received event network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:03:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] Acquiring lock "59d7b86a-c723-4255-827e-2f6a641239df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:03:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:03:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:58 user nova-compute[71692]: DEBUG nova.compute.manager [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] No waiting events found dispatching network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:03:58 user nova-compute[71692]: WARNING nova.compute.manager [req-cd3e09c2-fa96-40f8-b04b-90815de97601 req-9f09f446-73be-4189-b023-2f4f89383aef service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received unexpected event network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 for instance with vm_state building and task_state spawning.
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412639.405012, 29eeca99-f237-49d9-9c7d-5c5b7ff2892f => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:03:59 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] VM Resumed (Lifecycle Event)
Apr 13 19:03:59 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Instance spawned successfully.
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:03:59 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Instance spawned successfully.
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:03:59 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412639.4057431, 29eeca99-f237-49d9-9c7d-5c5b7ff2892f => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:03:59 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] VM Started (Lifecycle Event)
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:03:59 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412639.4065883, 59d7b86a-c723-4255-827e-2f6a641239df => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:03:59 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] VM Resumed (Lifecycle Event)
Apr 13 19:03:59 user nova-compute[71692]: INFO nova.compute.manager [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Took 6.61 seconds to spawn the instance on the hypervisor.
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:03:59 user nova-compute[71692]: INFO nova.compute.manager [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Took 7.54 seconds to spawn the instance on the hypervisor.
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:03:59 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412639.40736, 59d7b86a-c723-4255-827e-2f6a641239df => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:03:59 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] VM Started (Lifecycle Event)
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:03:59 user nova-compute[71692]: INFO nova.compute.manager [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Took 7.41 seconds to build instance.
Apr 13 19:03:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec0913c8-92a5-405d-8194-cc0ab20c19a9 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "59d7b86a-c723-4255-827e-2f6a641239df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.562s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:59 user nova-compute[71692]: INFO nova.compute.manager [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Took 8.27 seconds to build instance.
Apr 13 19:03:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e78994a1-b097-4077-91a0-1a4fd36d35fe tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.393s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:03:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:04:10 user nova-compute[71692]: INFO nova.compute.claims [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Claim successful on node user
Apr 13 19:04:10 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:04:10 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:04:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG nova.policy [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee6c76c605d54b4f84e0596b27087f0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faabdcc8e61c452ab3b934b1c9501e68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:04:10 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Creating image(s)
Apr 13 19:04:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "/opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "/opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.170s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.157s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk 1073741824" returned: 0 in 0.050s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Cannot resize image /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'migration_context' on Instance uuid 2c2e4899-d6d5-422c-a4f1-61a8129abdae {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Ensure instance console log exists: /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:11 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Successfully created port: 071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.objects.instance [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'flavor' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquired lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.objects.instance [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'info_cache' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Successfully updated port: 071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquired lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-922d6787-8757-449f-9e38-5f445ec5a5d9 req-41307bf8-5a05-430a-9ad5-c374aa3cf513 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-changed-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-922d6787-8757-449f-9e38-5f445ec5a5d9 req-41307bf8-5a05-430a-9ad5-c374aa3cf513 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Refreshing instance network info cache due to event network-changed-071fd8c9-9400-42aa-ad88-1176bb1d4910. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-922d6787-8757-449f-9e38-5f445ec5a5d9 req-41307bf8-5a05-430a-9ad5-c374aa3cf513 service nova] Acquiring lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Updating instance_info_cache with network_info: [{"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Releasing lock "refresh_cache-a15c1b5e-1769-490a-b81f-09333cd4a227" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:04:12 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Instance destroyed successfully.
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.objects.instance [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'resources' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-401678638',display_name='tempest-AttachVolumeTestJSON-server-401678638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-401678638',id=2,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE5B1S6SqZNLSYUvXCtLzlE03oQZAx0ezu9QmfHUm/VQFyAV9bhAsOFjrmYjBIjMOSTPvvajdVY1JHSqXEdUecpJFgE/NvFW0y7bhYdRssG3xIWyUJMMg1figOyi2kGeg==',key_name='tempest-keypair-1245494573',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:56:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='63b52d6508154a918a13b31712b32796',ramdisk_id='',reservation_id='r-ecb50eo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-43043273',owner_user_name='tempest-AttachVolumeTestJSON-43043273-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba70f34af8664dc89fd9851d00d5b96d',uuid=a15c1b5e-1769-490a-b81f-09333cd4a227,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converting VIF {"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG os_vif [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9907d23-58, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Updating instance_info_cache with network_info: [{"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:04:12 user nova-compute[71692]: INFO os_vif [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58')
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Start _get_guest_xml network_info=[{"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.objects.instance [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'numa_topology' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Releasing lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Instance network_info: |[{"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-922d6787-8757-449f-9e38-5f445ec5a5d9 req-41307bf8-5a05-430a-9ad5-c374aa3cf513 service nova] Acquired lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.network.neutron [req-922d6787-8757-449f-9e38-5f445ec5a5d9 req-41307bf8-5a05-430a-9ad5-c374aa3cf513 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Refreshing network info cache for port 071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Start _get_guest_xml network_info=[{"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:04:12 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:04:12 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1141253084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1141253084',id=16,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZe8WHxNPt+OEFTfKSkzy8wZuScIjzJeyBVbA3Z02RJMRIdLJty1zSrwoxsbVtyU7kpmUkL2gYS28J8h+WxdhP9nXELXUDvHj2w4B2VNtkzNPMfJnxeWpbUzlRv0BK2Kg==',key_name='tempest-keypair-1280930280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faabdcc8e61c452ab3b934b1c9501e68',ramdisk_id='',reservation_id='r-r0g030ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1546308967',owner_user_name='tempest-AttachVolumeShelveTestJSON-1546308967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:04:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee6c76c605d54b4f84e0596b27087f0b',uuid=2c2e4899-d6d5-422c-a4f1-61a8129abdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converting VIF {"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:dd:1f,bridge_name='br-int',has_traffic_filtering=True,id=071fd8c9-9400-42aa-ad88-1176bb1d4910,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071fd8c9-94') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c2e4899-d6d5-422c-a4f1-61a8129abdae {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:04:12 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:04:12 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.objects.instance [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'vcpu_model' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:04:12 user nova-compute[71692]:   <uuid>2c2e4899-d6d5-422c-a4f1-61a8129abdae</uuid>
Apr 13 19:04:12 user nova-compute[71692]:   <name>instance-00000010</name>
Apr 13 19:04:12 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:04:12 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:04:12 user nova-compute[71692]:   <metadata>
Apr 13 19:04:12 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:04:12 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:04:12 user nova-compute[71692]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1141253084</nova:name>
Apr 13 19:04:12 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:04:12</nova:creationTime>
Apr 13 19:04:12 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:04:12 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:04:12 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:04:12 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:04:12 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:04:12 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:04:12 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:04:12 user nova-compute[71692]:       <nova:owner>
Apr 13 19:04:12 user nova-compute[71692]:         <nova:user uuid="ee6c76c605d54b4f84e0596b27087f0b">tempest-AttachVolumeShelveTestJSON-1546308967-project-member</nova:user>
Apr 13 19:04:12 user nova-compute[71692]:         <nova:project uuid="faabdcc8e61c452ab3b934b1c9501e68">tempest-AttachVolumeShelveTestJSON-1546308967</nova:project>
Apr 13 19:04:12 user nova-compute[71692]:       </nova:owner>
Apr 13 19:04:12 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:04:12 user nova-compute[71692]:       <nova:ports>
Apr 13 19:04:12 user nova-compute[71692]:         <nova:port uuid="071fd8c9-9400-42aa-ad88-1176bb1d4910">
Apr 13 19:04:12 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 19:04:12 user nova-compute[71692]:         </nova:port>
Apr 13 19:04:12 user nova-compute[71692]:       </nova:ports>
Apr 13 19:04:12 user nova-compute[71692]:     </nova:instance>
Apr 13 19:04:12 user nova-compute[71692]:   </metadata>
Apr 13 19:04:12 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:04:12 user nova-compute[71692]:     <system>
Apr 13 19:04:12 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:04:12 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:04:12 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:04:12 user nova-compute[71692]:       <entry name="serial">2c2e4899-d6d5-422c-a4f1-61a8129abdae</entry>
Apr 13 19:04:12 user nova-compute[71692]:       <entry name="uuid">2c2e4899-d6d5-422c-a4f1-61a8129abdae</entry>
Apr 13 19:04:12 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:04:12 user nova-compute[71692]:     </system>
Apr 13 19:04:12 user nova-compute[71692]:   </sysinfo>
Apr 13 19:04:12 user nova-compute[71692]:   <os>
Apr 13 19:04:12 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:04:12 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:04:12 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:04:12 user nova-compute[71692]:   </os>
Apr 13 19:04:12 user nova-compute[71692]:   <features>
Apr 13 19:04:12 user nova-compute[71692]:     <acpi/>
Apr 13 19:04:12 user nova-compute[71692]:     <apic/>
Apr 13 19:04:12 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:04:12 user nova-compute[71692]:   </features>
Apr 13 19:04:12 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:04:12 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:04:12 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:04:12 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:04:12 user nova-compute[71692]:   </clock>
Apr 13 19:04:12 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:04:12 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:04:12 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:04:12 user nova-compute[71692]:   </cpu>
Apr 13 19:04:12 user nova-compute[71692]:   <devices>
Apr 13 19:04:12 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:04:12 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:04:12 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk"/>
Apr 13 19:04:12 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:04:12 user nova-compute[71692]:     </disk>
Apr 13 19:04:12 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:04:12 user nova-compute[71692]:       <mac address="fa:16:3e:bd:dd:1f"/>
Apr 13 19:04:12 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:04:12 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:04:12 user nova-compute[71692]:       <target dev="tap071fd8c9-94"/>
Apr 13 19:04:12 user nova-compute[71692]:     </interface>
Apr 13 19:04:12 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:04:12 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/console.log" append="off"/>
Apr 13 19:04:12 user nova-compute[71692]:     </serial>
Apr 13 19:04:12 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:04:12 user nova-compute[71692]:     <video>
Apr 13 19:04:12 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:04:12 user nova-compute[71692]:     </video>
Apr 13 19:04:12 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:04:12 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:04:12 user nova-compute[71692]:     </rng>
Apr 13 19:04:12 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:04:12 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:04:12 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:04:12 user nova-compute[71692]:     </memballoon>
Apr 13 19:04:12 user nova-compute[71692]:   </devices>
Apr 13 19:04:12 user nova-compute[71692]: </domain>
Apr 13 19:04:12 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1141253084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1141253084',id=16,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZe8WHxNPt+OEFTfKSkzy8wZuScIjzJeyBVbA3Z02RJMRIdLJty1zSrwoxsbVtyU7kpmUkL2gYS28J8h+WxdhP9nXELXUDvHj2w4B2VNtkzNPMfJnxeWpbUzlRv0BK2Kg==',key_name='tempest-keypair-1280930280',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='faabdcc8e61c452ab3b934b1c9501e68',ramdisk_id='',reservation_id='r-r0g030ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1546308967',owner_user_name='tempest-AttachVolumeShelveTestJSON-1546308967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:04:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee6c76c605d54b4f84e0596b27087f0b',uuid=2c2e4899-d6d5-422c-a4f1-61a8129abdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converting VIF {"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:dd:1f,bridge_name='br-int',has_traffic_filtering=True,id=071fd8c9-9400-42aa-ad88-1176bb1d4910,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071fd8c9-94') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG os_vif [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:dd:1f,bridge_name='br-int',has_traffic_filtering=True,id=071fd8c9-9400-42aa-ad88-1176bb1d4910,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071fd8c9-94') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-401678638',display_name='tempest-AttachVolumeTestJSON-server-401678638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-401678638',id=2,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE5B1S6SqZNLSYUvXCtLzlE03oQZAx0ezu9QmfHUm/VQFyAV9bhAsOFjrmYjBIjMOSTPvvajdVY1JHSqXEdUecpJFgE/NvFW0y7bhYdRssG3xIWyUJMMg1figOyi2kGeg==',key_name='tempest-keypair-1245494573',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:56:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='63b52d6508154a918a13b31712b32796',ramdisk_id='',reservation_id='r-ecb50eo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-43043273',owner_user_name='tempest-AttachVolumeTestJSON-43043273-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba70f34af8664dc89fd9851d00d5b96d',uuid=a15c1b5e-1769-490a-b81f-09333cd4a227,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converting VIF {"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.objects.instance [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'pci_devices' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap071fd8c9-94, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap071fd8c9-94, col_values=(('external_ids', {'iface-id': '071fd8c9-9400-42aa-ad88-1176bb1d4910', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:dd:1f', 'vm-uuid': '2c2e4899-d6d5-422c-a4f1-61a8129abdae'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:04:12 user nova-compute[71692]:   <uuid>a15c1b5e-1769-490a-b81f-09333cd4a227</uuid>
Apr 13 19:04:12 user nova-compute[71692]:   <name>instance-00000002</name>
Apr 13 19:04:12 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:04:12 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:04:12 user nova-compute[71692]:   <metadata>
Apr 13 19:04:12 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:04:12 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:04:12 user nova-compute[71692]:       <nova:name>tempest-AttachVolumeTestJSON-server-401678638</nova:name>
Apr 13 19:04:12 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:04:12</nova:creationTime>
Apr 13 19:04:12 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:04:12 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:04:12 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:04:12 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:04:12 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:04:12 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:04:12 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:04:12 user nova-compute[71692]:       <nova:owner>
Apr 13 19:04:12 user nova-compute[71692]:         <nova:user uuid="ba70f34af8664dc89fd9851d00d5b96d">tempest-AttachVolumeTestJSON-43043273-project-member</nova:user>
Apr 13 19:04:12 user nova-compute[71692]:         <nova:project uuid="63b52d6508154a918a13b31712b32796">tempest-AttachVolumeTestJSON-43043273</nova:project>
Apr 13 19:04:12 user nova-compute[71692]:       </nova:owner>
Apr 13 19:04:12 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:04:12 user nova-compute[71692]:       <nova:ports>
Apr 13 19:04:12 user nova-compute[71692]:         <nova:port uuid="a9907d23-585e-46b6-935d-d2d1f7d840f2">
Apr 13 19:04:12 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 19:04:12 user nova-compute[71692]:         </nova:port>
Apr 13 19:04:12 user nova-compute[71692]:       </nova:ports>
Apr 13 19:04:12 user nova-compute[71692]:     </nova:instance>
Apr 13 19:04:12 user nova-compute[71692]:   </metadata>
Apr 13 19:04:12 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:04:12 user nova-compute[71692]:     <system>
Apr 13 19:04:12 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:04:12 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:04:12 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:04:12 user nova-compute[71692]:       <entry name="serial">a15c1b5e-1769-490a-b81f-09333cd4a227</entry>
Apr 13 19:04:12 user nova-compute[71692]:       <entry name="uuid">a15c1b5e-1769-490a-b81f-09333cd4a227</entry>
Apr 13 19:04:12 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:04:12 user nova-compute[71692]:     </system>
Apr 13 19:04:12 user nova-compute[71692]:   </sysinfo>
Apr 13 19:04:12 user nova-compute[71692]:   <os>
Apr 13 19:04:12 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:04:12 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:04:12 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:04:12 user nova-compute[71692]:   </os>
Apr 13 19:04:12 user nova-compute[71692]:   <features>
Apr 13 19:04:12 user nova-compute[71692]:     <acpi/>
Apr 13 19:04:12 user nova-compute[71692]:     <apic/>
Apr 13 19:04:12 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:04:12 user nova-compute[71692]:   </features>
Apr 13 19:04:12 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:04:12 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:04:12 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:04:12 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:04:12 user nova-compute[71692]:   </clock>
Apr 13 19:04:12 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:04:12 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:04:12 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:04:12 user nova-compute[71692]:   </cpu>
Apr 13 19:04:12 user nova-compute[71692]:   <devices>
Apr 13 19:04:12 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:04:12 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:04:12 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk"/>
Apr 13 19:04:12 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:04:12 user nova-compute[71692]:     </disk>
Apr 13 19:04:12 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:04:12 user nova-compute[71692]:       <mac address="fa:16:3e:7b:3b:25"/>
Apr 13 19:04:12 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:04:12 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:04:12 user nova-compute[71692]:       <target dev="tapa9907d23-58"/>
Apr 13 19:04:12 user nova-compute[71692]:     </interface>
Apr 13 19:04:12 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:04:12 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/console.log" append="off"/>
Apr 13 19:04:12 user nova-compute[71692]:     </serial>
Apr 13 19:04:12 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:04:12 user nova-compute[71692]:     <video>
Apr 13 19:04:12 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:04:12 user nova-compute[71692]:     </video>
Apr 13 19:04:12 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:04:12 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:04:12 user nova-compute[71692]:     </rng>
Apr 13 19:04:12 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:04:12 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:04:12 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:04:12 user nova-compute[71692]:     </memballoon>
Apr 13 19:04:12 user nova-compute[71692]:   </devices>
Apr 13 19:04:12 user nova-compute[71692]: </domain>
Apr 13 19:04:12 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:12 user nova-compute[71692]: INFO os_vif [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:dd:1f,bridge_name='br-int',has_traffic_filtering=True,id=071fd8c9-9400-42aa-ad88-1176bb1d4910,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071fd8c9-94')
Apr 13 19:04:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] No VIF found with MAC fa:16:3e:bd:dd:1f, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG nova.objects.instance [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'trusted_certs' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG nova.network.neutron [req-922d6787-8757-449f-9e38-5f445ec5a5d9 req-41307bf8-5a05-430a-9ad5-c374aa3cf513 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Updated VIF entry in instance network info cache for port 071fd8c9-9400-42aa-ad88-1176bb1d4910. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG nova.network.neutron [req-922d6787-8757-449f-9e38-5f445ec5a5d9 req-41307bf8-5a05-430a-9ad5-c374aa3cf513 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Updating instance_info_cache with network_info: [{"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Cannot resize image /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG nova.objects.instance [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'migration_context' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-922d6787-8757-449f-9e38-5f445ec5a5d9 req-41307bf8-5a05-430a-9ad5-c374aa3cf513 service nova] Releasing lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-401678638',display_name='tempest-AttachVolumeTestJSON-server-401678638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-401678638',id=2,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE5B1S6SqZNLSYUvXCtLzlE03oQZAx0ezu9QmfHUm/VQFyAV9bhAsOFjrmYjBIjMOSTPvvajdVY1JHSqXEdUecpJFgE/NvFW0y7bhYdRssG3xIWyUJMMg1figOyi2kGeg==',key_name='tempest-keypair-1245494573',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:56:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='63b52d6508154a918a13b31712b32796',ramdisk_id='',reservation_id='r-ecb50eo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-43043273',owner_user_name='tempest-AttachVolumeTestJSON-43043273-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:02:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba70f34af8664dc89fd9851d00d5b96d',uuid=a15c1b5e-1769-490a-b81f-09333cd4a227,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converting VIF {"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG os_vif [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9907d23-58, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9907d23-58, col_values=(('external_ids', {'iface-id': 'a9907d23-585e-46b6-935d-d2d1f7d840f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:3b:25', 'vm-uuid': 'a15c1b5e-1769-490a-b81f-09333cd4a227'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:04:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:13 user nova-compute[71692]: INFO os_vif [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58')
Apr 13 19:04:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-dda9d4e3-b8a3-49ce-8239-d2ec5b5baa26 req-a4c081b7-3d7b-43b6-a7c7-951cf26c69c4 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:04:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dda9d4e3-b8a3-49ce-8239-d2ec5b5baa26 req-a4c081b7-3d7b-43b6-a7c7-951cf26c69c4 service nova] Acquiring lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dda9d4e3-b8a3-49ce-8239-d2ec5b5baa26 req-a4c081b7-3d7b-43b6-a7c7-951cf26c69c4 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dda9d4e3-b8a3-49ce-8239-d2ec5b5baa26 req-a4c081b7-3d7b-43b6-a7c7-951cf26c69c4 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-dda9d4e3-b8a3-49ce-8239-d2ec5b5baa26 req-a4c081b7-3d7b-43b6-a7c7-951cf26c69c4 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] No waiting events found dispatching network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:04:14 user nova-compute[71692]: WARNING nova.compute.manager [req-dda9d4e3-b8a3-49ce-8239-d2ec5b5baa26 req-a4c081b7-3d7b-43b6-a7c7-951cf26c69c4 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received unexpected event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance with vm_state building and task_state spawning.
Apr 13 19:04:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-a963b631-7cdb-4da2-b80f-fbed5c6f6f28 req-504f66f6-4bb2-462c-baf9-393349b7410c service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:04:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a963b631-7cdb-4da2-b80f-fbed5c6f6f28 req-504f66f6-4bb2-462c-baf9-393349b7410c service nova] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a963b631-7cdb-4da2-b80f-fbed5c6f6f28 req-504f66f6-4bb2-462c-baf9-393349b7410c service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a963b631-7cdb-4da2-b80f-fbed5c6f6f28 req-504f66f6-4bb2-462c-baf9-393349b7410c service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-a963b631-7cdb-4da2-b80f-fbed5c6f6f28 req-504f66f6-4bb2-462c-baf9-393349b7410c service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] No waiting events found dispatching network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:04:16 user nova-compute[71692]: WARNING nova.compute.manager [req-a963b631-7cdb-4da2-b80f-fbed5c6f6f28 req-504f66f6-4bb2-462c-baf9-393349b7410c service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received unexpected event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance with vm_state stopped and task_state powering-on.
Apr 13 19:04:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-6bf761b6-4d0e-4ab6-8622-d6500bf1bcfe req-53c4ad14-08d4-4250-85a8-61ab6c4d01b7 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:04:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6bf761b6-4d0e-4ab6-8622-d6500bf1bcfe req-53c4ad14-08d4-4250-85a8-61ab6c4d01b7 service nova] Acquiring lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6bf761b6-4d0e-4ab6-8622-d6500bf1bcfe req-53c4ad14-08d4-4250-85a8-61ab6c4d01b7 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6bf761b6-4d0e-4ab6-8622-d6500bf1bcfe req-53c4ad14-08d4-4250-85a8-61ab6c4d01b7 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-6bf761b6-4d0e-4ab6-8622-d6500bf1bcfe req-53c4ad14-08d4-4250-85a8-61ab6c4d01b7 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] No waiting events found dispatching network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:04:16 user nova-compute[71692]: WARNING nova.compute.manager [req-6bf761b6-4d0e-4ab6-8622-d6500bf1bcfe req-53c4ad14-08d4-4250-85a8-61ab6c4d01b7 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received unexpected event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance with vm_state building and task_state spawning.
Apr 13 19:04:17 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412657.6794398, 2c2e4899-d6d5-422c-a4f1-61a8129abdae => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:04:17 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] VM Resumed (Lifecycle Event)
Apr 13 19:04:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:04:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:04:17 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Instance spawned successfully.
Apr 13 19:04:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:04:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:04:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:04:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:04:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:04:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:04:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:04:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:04:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:04:17 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:04:17 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412657.6837702, 2c2e4899-d6d5-422c-a4f1-61a8129abdae => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:04:17 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] VM Started (Lifecycle Event)
Apr 13 19:04:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:04:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:04:17 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:04:17 user nova-compute[71692]: INFO nova.compute.manager [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Took 7.07 seconds to spawn the instance on the hypervisor.
Apr 13 19:04:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:04:17 user nova-compute[71692]: INFO nova.compute.manager [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Took 7.72 seconds to build instance.
Apr 13 19:04:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ceecbbd0-d66f-4216-b820-49ee10421bc4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.845s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:18 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412658.0801342, a15c1b5e-1769-490a-b81f-09333cd4a227 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:04:18 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] VM Resumed (Lifecycle Event)
Apr 13 19:04:18 user nova-compute[71692]: DEBUG nova.compute.manager [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:04:18 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Instance rebooted successfully.
Apr 13 19:04:18 user nova-compute[71692]: DEBUG nova.compute.manager [None req-10a508f6-a313-48e0-bba6-5b71a5b2e37d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:04:18 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:04:18 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:04:18 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 13 19:04:18 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412658.0844793, a15c1b5e-1769-490a-b81f-09333cd4a227 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:04:18 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] VM Started (Lifecycle Event)
Apr 13 19:04:18 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:04:18 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:04:18 user nova-compute[71692]: DEBUG nova.compute.manager [req-99047305-c63c-4607-94d0-f0cb193e114e req-d7a86f3c-54f4-4a3f-971d-43db1b8870fb service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:04:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-99047305-c63c-4607-94d0-f0cb193e114e req-d7a86f3c-54f4-4a3f-971d-43db1b8870fb service nova] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-99047305-c63c-4607-94d0-f0cb193e114e req-d7a86f3c-54f4-4a3f-971d-43db1b8870fb service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-99047305-c63c-4607-94d0-f0cb193e114e req-d7a86f3c-54f4-4a3f-971d-43db1b8870fb service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:18 user nova-compute[71692]: DEBUG nova.compute.manager [req-99047305-c63c-4607-94d0-f0cb193e114e req-d7a86f3c-54f4-4a3f-971d-43db1b8870fb service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] No waiting events found dispatching network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:04:18 user nova-compute[71692]: WARNING nova.compute.manager [req-99047305-c63c-4607-94d0-f0cb193e114e req-d7a86f3c-54f4-4a3f-971d-43db1b8870fb service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received unexpected event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance with vm_state active and task_state None.
Apr 13 19:04:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:30 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:04:30 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:31 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:04:32 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:04:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:34 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:04:34 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:04:34 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:04:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:36 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:04:36 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:04:36 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:04:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:36 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:04:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:38 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:04:38 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:04:38 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8057MB free_disk=26.316200256347656GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:04:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:38 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance a15c1b5e-1769-490a-b81f-09333cd4a227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:04:38 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance f17525a6-e377-4b33-85cd-88a7aaf4569a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:04:38 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:04:38 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:04:38 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:04:38 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 59d7b86a-c723-4255-827e-2f6a641239df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:04:38 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:04:38 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:04:38 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:04:39 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:04:39 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:04:39 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:04:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:40 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:04:40 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:04:40 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:04:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-f17525a6-e377-4b33-85cd-88a7aaf4569a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:04:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-f17525a6-e377-4b33-85cd-88a7aaf4569a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:04:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:04:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Updating instance_info_cache with network_info: [{"id": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "address": "fa:16:3e:01:cf:b5", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209c6974-cf", "ovs_interfaceid": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:04:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-f17525a6-e377-4b33-85cd-88a7aaf4569a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:04:40 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:04:41 user nova-compute[71692]: INFO nova.compute.claims [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Claim successful on node user
Apr 13 19:04:41 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG nova.network.neutron [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:04:41 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:04:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG nova.policy [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb7bcc69770a4859904f1b66cece61e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347c59f4ca945399a4323e689460d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:04:41 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Creating image(s)
Apr 13 19:04:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "/opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "/opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk 1073741824" returned: 0 in 0.047s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG nova.network.neutron [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Successfully created port: cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Cannot resize image /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG nova.objects.instance [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lazy-loading 'migration_context' on Instance uuid cb3fb753-ff8d-4dac-ab70-f940233bf25d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Ensure instance console log exists: /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG nova.network.neutron [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Successfully updated port: cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "refresh_cache-cb3fb753-ff8d-4dac-ab70-f940233bf25d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquired lock "refresh_cache-cb3fb753-ff8d-4dac-ab70-f940233bf25d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG nova.network.neutron [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-4a05ac3d-2efb-4d12-a65d-b93cbbd52a70 req-267b88a7-cc3d-43d4-83cc-f299e22321ab service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Received event network-changed-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-4a05ac3d-2efb-4d12-a65d-b93cbbd52a70 req-267b88a7-cc3d-43d4-83cc-f299e22321ab service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Refreshing instance network info cache due to event network-changed-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4a05ac3d-2efb-4d12-a65d-b93cbbd52a70 req-267b88a7-cc3d-43d4-83cc-f299e22321ab service nova] Acquiring lock "refresh_cache-cb3fb753-ff8d-4dac-ab70-f940233bf25d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:04:42 user nova-compute[71692]: DEBUG nova.network.neutron [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.network.neutron [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Updating instance_info_cache with network_info: [{"id": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "address": "fa:16:3e:fd:ca:76", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec3cf4d-fe", "ovs_interfaceid": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Releasing lock "refresh_cache-cb3fb753-ff8d-4dac-ab70-f940233bf25d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Instance network_info: |[{"id": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "address": "fa:16:3e:fd:ca:76", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec3cf4d-fe", "ovs_interfaceid": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4a05ac3d-2efb-4d12-a65d-b93cbbd52a70 req-267b88a7-cc3d-43d4-83cc-f299e22321ab service nova] Acquired lock "refresh_cache-cb3fb753-ff8d-4dac-ab70-f940233bf25d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.network.neutron [req-4a05ac3d-2efb-4d12-a65d-b93cbbd52a70 req-267b88a7-cc3d-43d4-83cc-f299e22321ab service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Refreshing network info cache for port cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Start _get_guest_xml network_info=[{"id": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "address": "fa:16:3e:fd:ca:76", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec3cf4d-fe", "ovs_interfaceid": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:04:43 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:04:43 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:04:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-115859800',display_name='tempest-TestStampPattern-server-115859800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-115859800',id=17,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHlW3C03mbx8npnGQJlBa+Z8VKTTGNO9FQPBpbP73f2RM1T737WN8fLrDdW9N64l6RsTGIQydByfuY41AlVN9GkKHEdIxhoJ63MlO2Jt2MVwCLy66RUUbGjTxXc1hX0iw==',key_name='tempest-TestStampPattern-550784019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3347c59f4ca945399a4323e689460d12',ramdisk_id='',reservation_id='r-yqry0b89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-456915878',owner_user_name='tempest-TestStampPattern-456915878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:04:42Z,user_data=None,user_id='cb7bcc69770a4859904f1b66cece61e3',uuid=cb3fb753-ff8d-4dac-ab70-f940233bf25d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "address": "fa:16:3e:fd:ca:76", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec3cf4d-fe", "ovs_interfaceid": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Converting VIF {"id": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "address": "fa:16:3e:fd:ca:76", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec3cf4d-fe", "ovs_interfaceid": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ca:76,bridge_name='br-int',has_traffic_filtering=True,id=cec3cf4d-fe86-45a6-97cc-5cbcf2be5818,network=Network(a5157bcb-9174-46af-b786-e4b159907e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec3cf4d-fe') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.objects.instance [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lazy-loading 'pci_devices' on Instance uuid cb3fb753-ff8d-4dac-ab70-f940233bf25d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:04:43 user nova-compute[71692]:   <uuid>cb3fb753-ff8d-4dac-ab70-f940233bf25d</uuid>
Apr 13 19:04:43 user nova-compute[71692]:   <name>instance-00000011</name>
Apr 13 19:04:43 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:04:43 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:04:43 user nova-compute[71692]:   <metadata>
Apr 13 19:04:43 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:04:43 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:04:43 user nova-compute[71692]:       <nova:name>tempest-TestStampPattern-server-115859800</nova:name>
Apr 13 19:04:43 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:04:43</nova:creationTime>
Apr 13 19:04:43 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:04:43 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:04:43 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:04:43 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:04:43 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:04:43 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:04:43 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:04:43 user nova-compute[71692]:       <nova:owner>
Apr 13 19:04:43 user nova-compute[71692]:         <nova:user uuid="cb7bcc69770a4859904f1b66cece61e3">tempest-TestStampPattern-456915878-project-member</nova:user>
Apr 13 19:04:43 user nova-compute[71692]:         <nova:project uuid="3347c59f4ca945399a4323e689460d12">tempest-TestStampPattern-456915878</nova:project>
Apr 13 19:04:43 user nova-compute[71692]:       </nova:owner>
Apr 13 19:04:43 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:04:43 user nova-compute[71692]:       <nova:ports>
Apr 13 19:04:43 user nova-compute[71692]:         <nova:port uuid="cec3cf4d-fe86-45a6-97cc-5cbcf2be5818">
Apr 13 19:04:43 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 19:04:43 user nova-compute[71692]:         </nova:port>
Apr 13 19:04:43 user nova-compute[71692]:       </nova:ports>
Apr 13 19:04:43 user nova-compute[71692]:     </nova:instance>
Apr 13 19:04:43 user nova-compute[71692]:   </metadata>
Apr 13 19:04:43 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:04:43 user nova-compute[71692]:     <system>
Apr 13 19:04:43 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:04:43 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:04:43 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:04:43 user nova-compute[71692]:       <entry name="serial">cb3fb753-ff8d-4dac-ab70-f940233bf25d</entry>
Apr 13 19:04:43 user nova-compute[71692]:       <entry name="uuid">cb3fb753-ff8d-4dac-ab70-f940233bf25d</entry>
Apr 13 19:04:43 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:04:43 user nova-compute[71692]:     </system>
Apr 13 19:04:43 user nova-compute[71692]:   </sysinfo>
Apr 13 19:04:43 user nova-compute[71692]:   <os>
Apr 13 19:04:43 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:04:43 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:04:43 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:04:43 user nova-compute[71692]:   </os>
Apr 13 19:04:43 user nova-compute[71692]:   <features>
Apr 13 19:04:43 user nova-compute[71692]:     <acpi/>
Apr 13 19:04:43 user nova-compute[71692]:     <apic/>
Apr 13 19:04:43 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:04:43 user nova-compute[71692]:   </features>
Apr 13 19:04:43 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:04:43 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:04:43 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:04:43 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:04:43 user nova-compute[71692]:   </clock>
Apr 13 19:04:43 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:04:43 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:04:43 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:04:43 user nova-compute[71692]:   </cpu>
Apr 13 19:04:43 user nova-compute[71692]:   <devices>
Apr 13 19:04:43 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:04:43 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:04:43 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk"/>
Apr 13 19:04:43 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:04:43 user nova-compute[71692]:     </disk>
Apr 13 19:04:43 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:04:43 user nova-compute[71692]:       <mac address="fa:16:3e:fd:ca:76"/>
Apr 13 19:04:43 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:04:43 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:04:43 user nova-compute[71692]:       <target dev="tapcec3cf4d-fe"/>
Apr 13 19:04:43 user nova-compute[71692]:     </interface>
Apr 13 19:04:43 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:04:43 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/console.log" append="off"/>
Apr 13 19:04:43 user nova-compute[71692]:     </serial>
Apr 13 19:04:43 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:04:43 user nova-compute[71692]:     <video>
Apr 13 19:04:43 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:04:43 user nova-compute[71692]:     </video>
Apr 13 19:04:43 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:04:43 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:04:43 user nova-compute[71692]:     </rng>
Apr 13 19:04:43 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:04:43 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:04:43 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:04:43 user nova-compute[71692]:     </memballoon>
Apr 13 19:04:43 user nova-compute[71692]:   </devices>
Apr 13 19:04:43 user nova-compute[71692]: </domain>
Apr 13 19:04:43 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:04:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-115859800',display_name='tempest-TestStampPattern-server-115859800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-115859800',id=17,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHlW3C03mbx8npnGQJlBa+Z8VKTTGNO9FQPBpbP73f2RM1T737WN8fLrDdW9N64l6RsTGIQydByfuY41AlVN9GkKHEdIxhoJ63MlO2Jt2MVwCLy66RUUbGjTxXc1hX0iw==',key_name='tempest-TestStampPattern-550784019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3347c59f4ca945399a4323e689460d12',ramdisk_id='',reservation_id='r-yqry0b89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-456915878',owner_user_name='tempest-TestStampPattern-456915878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:04:42Z,user_data=None,user_id='cb7bcc69770a4859904f1b66cece61e3',uuid=cb3fb753-ff8d-4dac-ab70-f940233bf25d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "address": "fa:16:3e:fd:ca:76", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec3cf4d-fe", "ovs_interfaceid": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Converting VIF {"id": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "address": "fa:16:3e:fd:ca:76", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec3cf4d-fe", "ovs_interfaceid": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ca:76,bridge_name='br-int',has_traffic_filtering=True,id=cec3cf4d-fe86-45a6-97cc-5cbcf2be5818,network=Network(a5157bcb-9174-46af-b786-e4b159907e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec3cf4d-fe') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG os_vif [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ca:76,bridge_name='br-int',has_traffic_filtering=True,id=cec3cf4d-fe86-45a6-97cc-5cbcf2be5818,network=Network(a5157bcb-9174-46af-b786-e4b159907e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec3cf4d-fe') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcec3cf4d-fe, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcec3cf4d-fe, col_values=(('external_ids', {'iface-id': 'cec3cf4d-fe86-45a6-97cc-5cbcf2be5818', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:ca:76', 'vm-uuid': 'cb3fb753-ff8d-4dac-ab70-f940233bf25d'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:43 user nova-compute[71692]: INFO os_vif [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:ca:76,bridge_name='br-int',has_traffic_filtering=True,id=cec3cf4d-fe86-45a6-97cc-5cbcf2be5818,network=Network(a5157bcb-9174-46af-b786-e4b159907e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec3cf4d-fe')
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:04:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] No VIF found with MAC fa:16:3e:fd:ca:76, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG nova.network.neutron [req-4a05ac3d-2efb-4d12-a65d-b93cbbd52a70 req-267b88a7-cc3d-43d4-83cc-f299e22321ab service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Updated VIF entry in instance network info cache for port cec3cf4d-fe86-45a6-97cc-5cbcf2be5818. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG nova.network.neutron [req-4a05ac3d-2efb-4d12-a65d-b93cbbd52a70 req-267b88a7-cc3d-43d4-83cc-f299e22321ab service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Updating instance_info_cache with network_info: [{"id": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "address": "fa:16:3e:fd:ca:76", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec3cf4d-fe", "ovs_interfaceid": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4a05ac3d-2efb-4d12-a65d-b93cbbd52a70 req-267b88a7-cc3d-43d4-83cc-f299e22321ab service nova] Releasing lock "refresh_cache-cb3fb753-ff8d-4dac-ab70-f940233bf25d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:44 user nova-compute[71692]: INFO nova.compute.manager [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Terminating instance
Apr 13 19:04:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-1b3d0b16-6a5b-46ae-b850-7c1c1b749cf1 req-401c3bcb-3696-4ba4-a813-4963690dc829 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received event network-vif-unplugged-b5d1f04b-5691-4b8b-a52c-d54bdb160292 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1b3d0b16-6a5b-46ae-b850-7c1c1b749cf1 req-401c3bcb-3696-4ba4-a813-4963690dc829 service nova] Acquiring lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1b3d0b16-6a5b-46ae-b850-7c1c1b749cf1 req-401c3bcb-3696-4ba4-a813-4963690dc829 service nova] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1b3d0b16-6a5b-46ae-b850-7c1c1b749cf1 req-401c3bcb-3696-4ba4-a813-4963690dc829 service nova] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-1b3d0b16-6a5b-46ae-b850-7c1c1b749cf1 req-401c3bcb-3696-4ba4-a813-4963690dc829 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] No waiting events found dispatching network-vif-unplugged-b5d1f04b-5691-4b8b-a52c-d54bdb160292 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-1b3d0b16-6a5b-46ae-b850-7c1c1b749cf1 req-401c3bcb-3696-4ba4-a813-4963690dc829 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received event network-vif-unplugged-b5d1f04b-5691-4b8b-a52c-d54bdb160292 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-f609bb65-79d0-4edc-88f8-89b780b33c94 req-d5a0f54a-b771-4c69-9a48-96bf2fff25bc service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Received event network-vif-plugged-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f609bb65-79d0-4edc-88f8-89b780b33c94 req-d5a0f54a-b771-4c69-9a48-96bf2fff25bc service nova] Acquiring lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f609bb65-79d0-4edc-88f8-89b780b33c94 req-d5a0f54a-b771-4c69-9a48-96bf2fff25bc service nova] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f609bb65-79d0-4edc-88f8-89b780b33c94 req-d5a0f54a-b771-4c69-9a48-96bf2fff25bc service nova] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-f609bb65-79d0-4edc-88f8-89b780b33c94 req-d5a0f54a-b771-4c69-9a48-96bf2fff25bc service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] No waiting events found dispatching network-vif-plugged-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:04:44 user nova-compute[71692]: WARNING nova.compute.manager [req-f609bb65-79d0-4edc-88f8-89b780b33c94 req-d5a0f54a-b771-4c69-9a48-96bf2fff25bc service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Received unexpected event network-vif-plugged-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 for instance with vm_state building and task_state spawning.
Apr 13 19:04:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:45 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Instance destroyed successfully.
Apr 13 19:04:45 user nova-compute[71692]: DEBUG nova.objects.instance [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lazy-loading 'resources' on Instance uuid 20edda40-d5dd-4c56-9c5d-023cfd330c8e {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:04:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-266550598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-266550598',id=13,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANNcqbVyx2+AlA6pJ67iCyDqokC0vj/8HKOcvYaotnci2ghezOK0wR9sJjzbtG6QMuvPDsNIPT54X8tzc1iHMAgDLsmrG5h7nHcBGX8mEcxODCqL7xCBPS67OL15k/VWg==',key_name='tempest-keypair-883887520',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:01:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee3a4f50c893404b94c839e86a55b47c',ramdisk_id='',reservation_id='r-ulgl580f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1514135387',owner_user_name='tempest-TaggedAttachmentsTest-1514135387-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:01:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ff67e015f5c4480919a0bd503abedc3',uuid=20edda40-d5dd-4c56-9c5d-023cfd330c8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "address": "fa:16:3e:10:5a:ab", "network": {"id": "3a84ff5b-fe4e-41eb-8cf9-6882fbec0275", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2050735987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d1f04b-56", "ovs_interfaceid": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:04:45 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Converting VIF {"id": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "address": "fa:16:3e:10:5a:ab", "network": {"id": "3a84ff5b-fe4e-41eb-8cf9-6882fbec0275", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-2050735987-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee3a4f50c893404b94c839e86a55b47c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5d1f04b-56", "ovs_interfaceid": "b5d1f04b-5691-4b8b-a52c-d54bdb160292", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:04:45 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:5a:ab,bridge_name='br-int',has_traffic_filtering=True,id=b5d1f04b-5691-4b8b-a52c-d54bdb160292,network=Network(3a84ff5b-fe4e-41eb-8cf9-6882fbec0275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d1f04b-56') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:04:45 user nova-compute[71692]: DEBUG os_vif [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:5a:ab,bridge_name='br-int',has_traffic_filtering=True,id=b5d1f04b-5691-4b8b-a52c-d54bdb160292,network=Network(3a84ff5b-fe4e-41eb-8cf9-6882fbec0275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d1f04b-56') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:04:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5d1f04b-56, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:04:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:04:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:45 user nova-compute[71692]: INFO os_vif [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:5a:ab,bridge_name='br-int',has_traffic_filtering=True,id=b5d1f04b-5691-4b8b-a52c-d54bdb160292,network=Network(3a84ff5b-fe4e-41eb-8cf9-6882fbec0275),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5d1f04b-56')
Apr 13 19:04:45 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Deleting instance files /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e_del
Apr 13 19:04:45 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Deletion of /opt/stack/data/nova/instances/20edda40-d5dd-4c56-9c5d-023cfd330c8e_del complete
Apr 13 19:04:45 user nova-compute[71692]: INFO nova.compute.manager [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 13 19:04:45 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:04:45 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:04:45 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:04:46 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:04:46 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Took 0.72 seconds to deallocate network for instance.
Apr 13 19:04:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:46 user nova-compute[71692]: DEBUG nova.compute.manager [req-6902632c-60ca-4cb6-9351-6306cb9f5531 req-f6c9b0ad-bee0-42ba-8de3-90e650c3f4f4 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received event network-vif-deleted-b5d1f04b-5691-4b8b-a52c-d54bdb160292 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:04:46 user nova-compute[71692]: INFO nova.compute.manager [req-6902632c-60ca-4cb6-9351-6306cb9f5531 req-f6c9b0ad-bee0-42ba-8de3-90e650c3f4f4 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Neutron deleted interface b5d1f04b-5691-4b8b-a52c-d54bdb160292; detaching it from the instance and deleting it from the info cache
Apr 13 19:04:46 user nova-compute[71692]: DEBUG nova.network.neutron [req-6902632c-60ca-4cb6-9351-6306cb9f5531 req-f6c9b0ad-bee0-42ba-8de3-90e650c3f4f4 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:04:46 user nova-compute[71692]: DEBUG nova.compute.manager [req-6902632c-60ca-4cb6-9351-6306cb9f5531 req-f6c9b0ad-bee0-42ba-8de3-90e650c3f4f4 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Detach interface failed, port_id=b5d1f04b-5691-4b8b-a52c-d54bdb160292, reason: Instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e could not be found. {{(pid=71692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 19:04:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:46 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:04:46 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:04:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:46 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Deleted allocations for instance 20edda40-d5dd-4c56-9c5d-023cfd330c8e
Apr 13 19:04:46 user nova-compute[71692]: DEBUG nova.compute.manager [req-7fbb7bc2-e5bb-47e9-a85b-6c922a8efd89 req-b92e8c61-1719-4ebc-8952-04c24e18b974 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received event network-vif-plugged-b5d1f04b-5691-4b8b-a52c-d54bdb160292 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:04:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7fbb7bc2-e5bb-47e9-a85b-6c922a8efd89 req-b92e8c61-1719-4ebc-8952-04c24e18b974 service nova] Acquiring lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7fbb7bc2-e5bb-47e9-a85b-6c922a8efd89 req-b92e8c61-1719-4ebc-8952-04c24e18b974 service nova] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7fbb7bc2-e5bb-47e9-a85b-6c922a8efd89 req-b92e8c61-1719-4ebc-8952-04c24e18b974 service nova] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:46 user nova-compute[71692]: DEBUG nova.compute.manager [req-7fbb7bc2-e5bb-47e9-a85b-6c922a8efd89 req-b92e8c61-1719-4ebc-8952-04c24e18b974 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] No waiting events found dispatching network-vif-plugged-b5d1f04b-5691-4b8b-a52c-d54bdb160292 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:04:46 user nova-compute[71692]: WARNING nova.compute.manager [req-7fbb7bc2-e5bb-47e9-a85b-6c922a8efd89 req-b92e8c61-1719-4ebc-8952-04c24e18b974 service nova] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Received unexpected event network-vif-plugged-b5d1f04b-5691-4b8b-a52c-d54bdb160292 for instance with vm_state deleted and task_state None.
Apr 13 19:04:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14b7ce2b-3f04-4024-b3c7-37e4254ade41 tempest-TaggedAttachmentsTest-1514135387 tempest-TaggedAttachmentsTest-1514135387-project-member] Lock "20edda40-d5dd-4c56-9c5d-023cfd330c8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.412s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:46 user nova-compute[71692]: DEBUG nova.compute.manager [req-34219c24-66b1-4760-859f-9bc08ab45b5e req-7794ae4d-eff1-4a47-89a1-0e84c712a493 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Received event network-vif-plugged-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:04:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-34219c24-66b1-4760-859f-9bc08ab45b5e req-7794ae4d-eff1-4a47-89a1-0e84c712a493 service nova] Acquiring lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:04:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-34219c24-66b1-4760-859f-9bc08ab45b5e req-7794ae4d-eff1-4a47-89a1-0e84c712a493 service nova] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:04:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-34219c24-66b1-4760-859f-9bc08ab45b5e req-7794ae4d-eff1-4a47-89a1-0e84c712a493 service nova] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:46 user nova-compute[71692]: DEBUG nova.compute.manager [req-34219c24-66b1-4760-859f-9bc08ab45b5e req-7794ae4d-eff1-4a47-89a1-0e84c712a493 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] No waiting events found dispatching network-vif-plugged-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:04:46 user nova-compute[71692]: WARNING nova.compute.manager [req-34219c24-66b1-4760-859f-9bc08ab45b5e req-7794ae4d-eff1-4a47-89a1-0e84c712a493 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Received unexpected event network-vif-plugged-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 for instance with vm_state building and task_state spawning.
Apr 13 19:04:47 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412687.112458, cb3fb753-ff8d-4dac-ab70-f940233bf25d => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:04:47 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] VM Resumed (Lifecycle Event)
Apr 13 19:04:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:04:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:04:47 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Instance spawned successfully.
Apr 13 19:04:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:04:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:04:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:04:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:04:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:04:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:04:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:04:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:04:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:04:47 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:04:47 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412687.1137135, cb3fb753-ff8d-4dac-ab70-f940233bf25d => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:04:47 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] VM Started (Lifecycle Event)
Apr 13 19:04:47 user nova-compute[71692]: INFO nova.compute.manager [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Took 5.49 seconds to spawn the instance on the hypervisor.
Apr 13 19:04:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:04:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:04:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:04:47 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:04:47 user nova-compute[71692]: INFO nova.compute.manager [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Took 6.19 seconds to build instance.
Apr 13 19:04:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c1834c56-a2ad-4cb9-9f69-b8d023d032d1 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.286s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:04:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:04:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:00 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412685.2822106, 20edda40-d5dd-4c56-9c5d-023cfd330c8e => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:05:00 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] VM Stopped (Lifecycle Event)
Apr 13 19:05:00 user nova-compute[71692]: DEBUG nova.compute.manager [None req-7060412a-cb43-447a-abf5-6a9df643461f None None] [instance: 20edda40-d5dd-4c56-9c5d-023cfd330c8e] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:05:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "f17525a6-e377-4b33-85cd-88a7aaf4569a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "f17525a6-e377-4b33-85cd-88a7aaf4569a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "f17525a6-e377-4b33-85cd-88a7aaf4569a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "f17525a6-e377-4b33-85cd-88a7aaf4569a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "f17525a6-e377-4b33-85cd-88a7aaf4569a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:23 user nova-compute[71692]: INFO nova.compute.manager [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Terminating instance
Apr 13 19:05:23 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:05:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:23 user nova-compute[71692]: DEBUG nova.compute.manager [req-394f29d9-519f-422f-9d88-7d1b5681846b req-29e166cd-270e-4448-a5e3-c52211df11bb service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Received event network-vif-unplugged-209c6974-cf54-4917-a9dc-2608f9eb10d9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:05:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-394f29d9-519f-422f-9d88-7d1b5681846b req-29e166cd-270e-4448-a5e3-c52211df11bb service nova] Acquiring lock "f17525a6-e377-4b33-85cd-88a7aaf4569a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-394f29d9-519f-422f-9d88-7d1b5681846b req-29e166cd-270e-4448-a5e3-c52211df11bb service nova] Lock "f17525a6-e377-4b33-85cd-88a7aaf4569a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-394f29d9-519f-422f-9d88-7d1b5681846b req-29e166cd-270e-4448-a5e3-c52211df11bb service nova] Lock "f17525a6-e377-4b33-85cd-88a7aaf4569a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:23 user nova-compute[71692]: DEBUG nova.compute.manager [req-394f29d9-519f-422f-9d88-7d1b5681846b req-29e166cd-270e-4448-a5e3-c52211df11bb service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] No waiting events found dispatching network-vif-unplugged-209c6974-cf54-4917-a9dc-2608f9eb10d9 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:05:23 user nova-compute[71692]: DEBUG nova.compute.manager [req-394f29d9-519f-422f-9d88-7d1b5681846b req-29e166cd-270e-4448-a5e3-c52211df11bb service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Received event network-vif-unplugged-209c6974-cf54-4917-a9dc-2608f9eb10d9 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:05:24 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Instance destroyed successfully.
Apr 13 19:05:24 user nova-compute[71692]: DEBUG nova.objects.instance [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lazy-loading 'resources' on Instance uuid f17525a6-e377-4b33-85cd-88a7aaf4569a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:05:24 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1933750656',display_name='tempest-ServersNegativeTestJSON-server-1933750656',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1933750656',id=3,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:56:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1308cc4c5734de9a9fd83688c8da796',ramdisk_id='',reservation_id='r-2ggqv3vi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1876599222',owner_user_name='tempest-ServersNegativeTestJSON-1876599222-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T18:56:53Z,user_data=None,user_id='3e7f76b4b7fb4651b3bce0e72f8a4de6',uuid=f17525a6-e377-4b33-85cd-88a7aaf4569a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "address": "fa:16:3e:01:cf:b5", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209c6974-cf", "ovs_interfaceid": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:05:24 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Converting VIF {"id": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "address": "fa:16:3e:01:cf:b5", "network": {"id": "ae895ef0-18d7-4f77-bcc6-bcb3dd22026f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-615728705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1308cc4c5734de9a9fd83688c8da796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap209c6974-cf", "ovs_interfaceid": "209c6974-cf54-4917-a9dc-2608f9eb10d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:05:24 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:cf:b5,bridge_name='br-int',has_traffic_filtering=True,id=209c6974-cf54-4917-a9dc-2608f9eb10d9,network=Network(ae895ef0-18d7-4f77-bcc6-bcb3dd22026f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209c6974-cf') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:05:24 user nova-compute[71692]: DEBUG os_vif [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:cf:b5,bridge_name='br-int',has_traffic_filtering=True,id=209c6974-cf54-4917-a9dc-2608f9eb10d9,network=Network(ae895ef0-18d7-4f77-bcc6-bcb3dd22026f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209c6974-cf') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:05:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap209c6974-cf, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:05:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:05:24 user nova-compute[71692]: INFO os_vif [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:cf:b5,bridge_name='br-int',has_traffic_filtering=True,id=209c6974-cf54-4917-a9dc-2608f9eb10d9,network=Network(ae895ef0-18d7-4f77-bcc6-bcb3dd22026f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap209c6974-cf')
Apr 13 19:05:24 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Deleting instance files /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a_del
Apr 13 19:05:24 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Deletion of /opt/stack/data/nova/instances/f17525a6-e377-4b33-85cd-88a7aaf4569a_del complete
Apr 13 19:05:24 user nova-compute[71692]: INFO nova.compute.manager [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 13 19:05:24 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:05:24 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:05:24 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:05:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:24 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:05:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-10783268-c3f4-4579-8e31-89509e270bc8 req-0a3a44d3-2c19-49f2-b831-a4406dcb5b0a service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Received event network-vif-deleted-209c6974-cf54-4917-a9dc-2608f9eb10d9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:05:24 user nova-compute[71692]: INFO nova.compute.manager [req-10783268-c3f4-4579-8e31-89509e270bc8 req-0a3a44d3-2c19-49f2-b831-a4406dcb5b0a service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Neutron deleted interface 209c6974-cf54-4917-a9dc-2608f9eb10d9; detaching it from the instance and deleting it from the info cache
Apr 13 19:05:24 user nova-compute[71692]: DEBUG nova.network.neutron [req-10783268-c3f4-4579-8e31-89509e270bc8 req-0a3a44d3-2c19-49f2-b831-a4406dcb5b0a service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:05:24 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Took 0.48 seconds to deallocate network for instance.
Apr 13 19:05:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-10783268-c3f4-4579-8e31-89509e270bc8 req-0a3a44d3-2c19-49f2-b831-a4406dcb5b0a service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Detach interface failed, port_id=209c6974-cf54-4917-a9dc-2608f9eb10d9, reason: Instance f17525a6-e377-4b33-85cd-88a7aaf4569a could not be found. {{(pid=71692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 19:05:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:25 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:05:25 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:05:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:25 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Deleted allocations for instance f17525a6-e377-4b33-85cd-88a7aaf4569a
Apr 13 19:05:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a2e32533-91ff-4c9c-b9d0-f47df95b65a3 tempest-ServersNegativeTestJSON-1876599222 tempest-ServersNegativeTestJSON-1876599222-project-member] Lock "f17525a6-e377-4b33-85cd-88a7aaf4569a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.792s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:25 user nova-compute[71692]: DEBUG nova.compute.manager [req-8e1f9a05-5e0f-415b-beec-b3b5756b65fc req-48ffa71a-9898-4555-b00b-d50f1da702ce service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Received event network-vif-plugged-209c6974-cf54-4917-a9dc-2608f9eb10d9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:05:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8e1f9a05-5e0f-415b-beec-b3b5756b65fc req-48ffa71a-9898-4555-b00b-d50f1da702ce service nova] Acquiring lock "f17525a6-e377-4b33-85cd-88a7aaf4569a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8e1f9a05-5e0f-415b-beec-b3b5756b65fc req-48ffa71a-9898-4555-b00b-d50f1da702ce service nova] Lock "f17525a6-e377-4b33-85cd-88a7aaf4569a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8e1f9a05-5e0f-415b-beec-b3b5756b65fc req-48ffa71a-9898-4555-b00b-d50f1da702ce service nova] Lock "f17525a6-e377-4b33-85cd-88a7aaf4569a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:25 user nova-compute[71692]: DEBUG nova.compute.manager [req-8e1f9a05-5e0f-415b-beec-b3b5756b65fc req-48ffa71a-9898-4555-b00b-d50f1da702ce service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] No waiting events found dispatching network-vif-plugged-209c6974-cf54-4917-a9dc-2608f9eb10d9 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:05:25 user nova-compute[71692]: WARNING nova.compute.manager [req-8e1f9a05-5e0f-415b-beec-b3b5756b65fc req-48ffa71a-9898-4555-b00b-d50f1da702ce service nova] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Received unexpected event network-vif-plugged-209c6974-cf54-4917-a9dc-2608f9eb10d9 for instance with vm_state deleted and task_state None.
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG nova.objects.instance [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'flavor' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:28 user nova-compute[71692]: INFO nova.compute.manager [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Attaching volume 50a307e4-f870-4d27-ba29-f61e22e6a414 to /dev/vdb
Apr 13 19:05:28 user nova-compute[71692]: DEBUG os_brick.utils [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd37027-7eba-4e14-b812-8211f7fadbff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb2c51b-3f44-41f0-bf16-50416e266279]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bc3968-abb9-408e-aef2-b08c81689343]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfcd8a9-d55b-4eeb-af02-94268df26946]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:05:28 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:05:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2861585f-6b88-49f6-86a1-2058036acc21]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG os_brick.utils [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:05:28 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating existing volume attachment record: 299653d9-fc42-4f62-8921-439f5b4eeafe {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:05:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyHemtYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:05:32 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:05:32 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:05:32 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b269f5-d969-479d-a7f2-67a43bc4c4a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:05:32 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9074d38b-aeba-4b3f-b6dd-c98e3d61e556]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414] added
Apr 13 19:05:32 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b771349b-8e45-43d0-8b3a-7906c3500f64]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccc1be9-2a89-4659-8c24-448c83d67766]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dyHemtYs {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dyHemtYs" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0aa2354-1bbc-4d57-bfdd-1095cf6e0288]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dyHemtYs'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[75258477-0296-4b90-b58d-21faf98c98e1]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9bb1fe-1b54-443f-8bcf-c8e0e178fc35]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 19:05:32 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 19:05:32 user nova-compute[71692]:  {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:05:32 user nova-compute[71692]: WARNING os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 19:05:32 user nova-compute[71692]: 
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c7175e-c01b-4c6b-9c71-efc0b705ec44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260]
Apr 13 19:05:32 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260] successful.
Apr 13 19:05:32 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1926e97-b778-4519-a839-925ea6fd012e]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6fe6d6-c7e0-45e5-8107-b0b0b704e2a8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:05:32 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:05:32 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:05:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6abdbb-63fc-4748-aadf-e7fd5b071be3]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:33 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:05:34 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:05:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyHemtYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:05:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:05:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23763326537656531', 'path': '/dev/sdb'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:05:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763326537656531', 'path': '/dev/sdb'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:05:34 user nova-compute[71692]: DEBUG nova.objects.instance [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'flavor' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:05:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:05:34 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:05:34 user nova-compute[71692]:   <source dev="/dev/sdb"/>
Apr 13 19:05:34 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:05:34 user nova-compute[71692]:   <serial>50a307e4-f870-4d27-ba29-f61e22e6a414</serial>
Apr 13 19:05:34 user nova-compute[71692]: </disk>
Apr 13 19:05:34 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:05:34 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:05:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:05:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:05:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No VIF found with MAC fa:16:3e:bc:71:09, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:05:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-6551d7a1-b0d5-47ce-82bd-31be53b89b5b tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.355s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:35 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:05:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:05:36 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:05:36 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:05:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:36 user nova-compute[71692]: DEBUG nova.compute.manager [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Stashing vm_state: active {{(pid=71692) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 13 19:05:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:36 user nova-compute[71692]: DEBUG nova.objects.instance [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'pci_requests' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:05:36 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:05:36 user nova-compute[71692]: INFO nova.compute.claims [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Claim successful on node user
Apr 13 19:05:36 user nova-compute[71692]: DEBUG nova.objects.instance [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'resources' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:05:36 user nova-compute[71692]: DEBUG nova.objects.instance [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'pci_devices' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:05:36 user nova-compute[71692]: INFO nova.compute.resource_tracker [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating resource usage from migration 95ab6c80-742d-4d26-a57b-7ba48d11618b
Apr 13 19:05:36 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:05:36 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:05:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.370s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:36 user nova-compute[71692]: INFO nova.compute.manager [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Migrating
Apr 13 19:05:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:05:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:05:36 user nova-compute[71692]: INFO nova.compute.rpcapi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 13 19:05:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:05:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:05:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquired lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:05:36 user nova-compute[71692]: DEBUG nova.network.neutron [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG nova.network.neutron [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating instance_info_cache with network_info: [{"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Releasing lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Starting migrate_disk_and_power_off {{(pid=71692) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG nova.compute.manager [req-064f38c7-9ee5-4714-92d9-b4f7797404ac req-5c283352-2b3f-4295-a380-e9f517f1efed service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-unplugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-064f38c7-9ee5-4714-92d9-b4f7797404ac req-5c283352-2b3f-4295-a380-e9f517f1efed service nova] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-064f38c7-9ee5-4714-92d9-b4f7797404ac req-5c283352-2b3f-4295-a380-e9f517f1efed service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-064f38c7-9ee5-4714-92d9-b4f7797404ac req-5c283352-2b3f-4295-a380-e9f517f1efed service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG nova.compute.manager [req-064f38c7-9ee5-4714-92d9-b4f7797404ac req-5c283352-2b3f-4295-a380-e9f517f1efed service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] No waiting events found dispatching network-vif-unplugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:05:37 user nova-compute[71692]: WARNING nova.compute.manager [req-064f38c7-9ee5-4714-92d9-b4f7797404ac req-5c283352-2b3f-4295-a380-e9f517f1efed service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received unexpected event network-vif-unplugged-2b297ca1-e672-438a-917a-df2319262bc0 for instance with vm_state active and task_state resize_migrating.
Apr 13 19:05:37 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating instance_info_cache with network_info: [{"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:05:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:05:38 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Instance destroyed successfully.
Apr 13 19:05:38 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T18:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-657008190',display_name='tempest-ServerActionsTestJSON-server-1417744922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-657008190',id=5,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:00:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-zw23yzik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:05:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-383984590-network", "vif_mac": "fa:16:3e:bc:71:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-383984590-network", "vif_mac": "fa:16:3e:bc:71:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_vif [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b297ca1-e6, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:05:38 user nova-compute[71692]: INFO os_vif [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6')
Apr 13 19:05:38 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyHemtYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:05:38 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9571c2-852f-417e-b137-5c8184d44d2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:05:38 user nova-compute[71692]: No targets found.
Apr 13 19:05:38 user nova-compute[71692]: iSNS:
Apr 13 19:05:38 user nova-compute[71692]: No targets found.
Apr 13 19:05:38 user nova-compute[71692]: STATIC:
Apr 13 19:05:38 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414
Apr 13 19:05:38 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:05:38 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:05:38 user nova-compute[71692]: FIRMWARE:
Apr 13 19:05:38 user nova-compute[71692]: No targets found.
Apr 13 19:05:38 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:05:38 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:05:38 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[45103646-ce77-449c-a070-c7ea0ea320c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[86af8e52-9143-4e48-bdf9-c8eb67ad24a2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:05:38 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:05:38 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febc421ef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414'): ({'sdb'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Removing single pathed devices sdb {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc71d0ab-e8c8-4662-8677-05a37f95a0a0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[84602b0a-7eb4-48af-ac81-732bf025d4dc]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flushing IO for device /dev/sdb {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea09b9c-6bc2-4658-8f05-2e99af7b3b53]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c665925-205c-4fb0-a5e3-90bd5f488f29]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59f97b9-1538-404a-85ba-ab1c04579bc7]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17c4e37-03cd-4ddc-9d7f-00e7c9fbad1f]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260]
Apr 13 19:05:38 user nova-compute[71692]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260] successful.
Apr 13 19:05:38 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d114ad-1076-4e1a-8b1e-77a27b430132]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== disconnect_volume: return (331ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8_resize/disk /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:38 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "cp -r /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8_resize/disk /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk" returned: 0 in 0.220s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8_resize/disk.info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk.info {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "cp -r /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8_resize/disk.info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk.info" returned: 0 in 0.038s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412724.2310169, f17525a6-e377-4b33-85cd-88a7aaf4569a => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:05:39 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] VM Stopped (Lifecycle Event)
Apr 13 19:05:39 user nova-compute[71692]: DEBUG nova.compute.manager [None req-36d39a34-cbde-4ba3-9e9a-c7422caaf1cf None None] [instance: f17525a6-e377-4b33-85cd-88a7aaf4569a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-0d5bed39-e187-400e-84ef-c9875326c723 req-c58a5aa8-5eb6-4ea1-a2ab-c667a5aa59fe service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d5bed39-e187-400e-84ef-c9875326c723 req-c58a5aa8-5eb6-4ea1-a2ab-c667a5aa59fe service nova] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d5bed39-e187-400e-84ef-c9875326c723 req-c58a5aa8-5eb6-4ea1-a2ab-c667a5aa59fe service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d5bed39-e187-400e-84ef-c9875326c723 req-c58a5aa8-5eb6-4ea1-a2ab-c667a5aa59fe service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-0d5bed39-e187-400e-84ef-c9875326c723 req-c58a5aa8-5eb6-4ea1-a2ab-c667a5aa59fe service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] No waiting events found dispatching network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:05:39 user nova-compute[71692]: WARNING nova.compute.manager [req-0d5bed39-e187-400e-84ef-c9875326c723 req-c58a5aa8-5eb6-4ea1-a2ab-c667a5aa59fe service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received unexpected event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 for instance with vm_state active and task_state resize_migrating.
Apr 13 19:05:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Port 2b297ca1-e672-438a-917a-df2319262bc0 binding to destination host user is already ACTIVE {{(pid=71692) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:40 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:05:40 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:05:40 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8254MB free_disk=26.31739044189453GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquired lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Applying migration context for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 as it has an incoming, in-progress migration 95ab6c80-742d-4d26-a57b-7ba48d11618b. Migration status is post-migrating {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 19:05:40 user nova-compute[71692]: INFO nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating resource usage from migration 95ab6c80-742d-4d26-a57b-7ba48d11618b
Apr 13 19:05:40 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance a15c1b5e-1769-490a-b81f-09333cd4a227 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 59d7b86a-c723-4255-827e-2f6a641239df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance cb3fb753-ff8d-4dac-ab70-f940233bf25d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Migration 95ab6c80-742d-4d26-a57b-7ba48d11618b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:05:40 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG nova.network.neutron [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating instance_info_cache with network_info: [{"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Releasing lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG os_brick.utils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f1d7ee-287a-47f0-9027-772379838e84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e228732-35c4-45f7-ab0b-bbadda3f4559]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec59c5d3-e2d3-463d-9bb7-7072324e51a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bed21a-e8f3-41e5-b90a-2d88b9e502cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:05:41 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:05:41 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b5843e-198a-42ac-8855-14f7ab9ce6e7]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:05:41 user nova-compute[71692]: DEBUG os_brick.utils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:05:42 user nova-compute[71692]: INFO nova.compute.manager [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Rescuing
Apr 13 19:05:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "refresh_cache-59d7b86a-c723-4255-827e-2f6a641239df" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:05:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquired lock "refresh_cache-59d7b86a-c723-4255-827e-2f6a641239df" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:05:42 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:05:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:43 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Updating instance_info_cache with network_info: [{"id": "3de4b459-2a9f-4570-80b1-dce61f40a377", "address": "fa:16:3e:de:c1:80", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4b459-2a", "ovs_interfaceid": "3de4b459-2a9f-4570-80b1-dce61f40a377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:05:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Releasing lock "refresh_cache-59d7b86a-c723-4255-827e-2f6a641239df" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:05:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-96740c2d-66b7-4ba0-8ffe-a168e56925f9 req-7169cf82-5f6c-4e48-b5c3-1418957db6d3 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received event network-vif-unplugged-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:05:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-96740c2d-66b7-4ba0-8ffe-a168e56925f9 req-7169cf82-5f6c-4e48-b5c3-1418957db6d3 service nova] Acquiring lock "59d7b86a-c723-4255-827e-2f6a641239df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-96740c2d-66b7-4ba0-8ffe-a168e56925f9 req-7169cf82-5f6c-4e48-b5c3-1418957db6d3 service nova] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-96740c2d-66b7-4ba0-8ffe-a168e56925f9 req-7169cf82-5f6c-4e48-b5c3-1418957db6d3 service nova] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-96740c2d-66b7-4ba0-8ffe-a168e56925f9 req-7169cf82-5f6c-4e48-b5c3-1418957db6d3 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] No waiting events found dispatching network-vif-unplugged-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:05:43 user nova-compute[71692]: WARNING nova.compute.manager [req-96740c2d-66b7-4ba0-8ffe-a168e56925f9 req-7169cf82-5f6c-4e48-b5c3-1418957db6d3 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received unexpected event network-vif-unplugged-3de4b459-2a9f-4570-80b1-dce61f40a377 for instance with vm_state active and task_state rescuing.
Apr 13 19:05:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:43 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Instance destroyed successfully.
Apr 13 19:05:43 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Attempting rescue
Apr 13 19:05:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71692) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 19:05:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Instance directory exists: not creating {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 19:05:43 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Creating image(s)
Apr 13 19:05:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "/opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "/opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "/opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:43 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'trusted_certs' on Instance uuid 59d7b86a-c723-4255-827e-2f6a641239df {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.154s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue" returned: 0 in 0.051s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'migration_context' on Instance uuid 59d7b86a-c723-4255-827e-2f6a641239df {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Start _get_guest_xml network_info=[{"id": "3de4b459-2a9f-4570-80b1-dce61f40a377", "address": "fa:16:3e:de:c1:80", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "vif_mac": "fa:16:3e:de:c1:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4b459-2a", "ovs_interfaceid": "3de4b459-2a9f-4570-80b1-dce61f40a377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'resources' on Instance uuid 59d7b86a-c723-4255-827e-2f6a641239df {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'numa_topology' on Instance uuid 59d7b86a-c723-4255-827e-2f6a641239df {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:05:44 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:05:44 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'vcpu_model' on Instance uuid 59d7b86a-c723-4255-827e-2f6a641239df {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:03:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1333783847',display_name='tempest-ServerRescueNegativeTestJSON-server-1333783847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1333783847',id=15,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42fbd7089a7e4ba8b2597fca0d8e84c8',ramdisk_id='',reservation_id='r-4fmtejoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1255770111',owner_user_name='tempest-ServerRescueNegativeTestJSON-1255770111-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:04:00Z,user_data=None,user_id='3bebf61a7401492692f9c60adde178f7',uuid=59d7b86a-c723-4255-827e-2f6a641239df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3de4b459-2a9f-4570-80b1-dce61f40a377", "address": "fa:16:3e:de:c1:80", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "vif_mac": "fa:16:3e:de:c1:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4b459-2a", "ovs_interfaceid": "3de4b459-2a9f-4570-80b1-dce61f40a377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converting VIF {"id": "3de4b459-2a9f-4570-80b1-dce61f40a377", "address": "fa:16:3e:de:c1:80", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "vif_mac": "fa:16:3e:de:c1:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4b459-2a", "ovs_interfaceid": "3de4b459-2a9f-4570-80b1-dce61f40a377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:c1:80,bridge_name='br-int',has_traffic_filtering=True,id=3de4b459-2a9f-4570-80b1-dce61f40a377,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4b459-2a') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'pci_devices' on Instance uuid 59d7b86a-c723-4255-827e-2f6a641239df {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:05:44 user nova-compute[71692]:   <uuid>59d7b86a-c723-4255-827e-2f6a641239df</uuid>
Apr 13 19:05:44 user nova-compute[71692]:   <name>instance-0000000f</name>
Apr 13 19:05:44 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:05:44 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:05:44 user nova-compute[71692]:   <metadata>
Apr 13 19:05:44 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:05:44 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:05:44 user nova-compute[71692]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1333783847</nova:name>
Apr 13 19:05:44 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:05:44</nova:creationTime>
Apr 13 19:05:44 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:05:44 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:05:44 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:05:44 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:05:44 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:05:44 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:05:44 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:05:44 user nova-compute[71692]:       <nova:owner>
Apr 13 19:05:44 user nova-compute[71692]:         <nova:user uuid="3bebf61a7401492692f9c60adde178f7">tempest-ServerRescueNegativeTestJSON-1255770111-project-member</nova:user>
Apr 13 19:05:44 user nova-compute[71692]:         <nova:project uuid="42fbd7089a7e4ba8b2597fca0d8e84c8">tempest-ServerRescueNegativeTestJSON-1255770111</nova:project>
Apr 13 19:05:44 user nova-compute[71692]:       </nova:owner>
Apr 13 19:05:44 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:05:44 user nova-compute[71692]:       <nova:ports>
Apr 13 19:05:44 user nova-compute[71692]:         <nova:port uuid="3de4b459-2a9f-4570-80b1-dce61f40a377">
Apr 13 19:05:44 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 19:05:44 user nova-compute[71692]:         </nova:port>
Apr 13 19:05:44 user nova-compute[71692]:       </nova:ports>
Apr 13 19:05:44 user nova-compute[71692]:     </nova:instance>
Apr 13 19:05:44 user nova-compute[71692]:   </metadata>
Apr 13 19:05:44 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:05:44 user nova-compute[71692]:     <system>
Apr 13 19:05:44 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:05:44 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:05:44 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:05:44 user nova-compute[71692]:       <entry name="serial">59d7b86a-c723-4255-827e-2f6a641239df</entry>
Apr 13 19:05:44 user nova-compute[71692]:       <entry name="uuid">59d7b86a-c723-4255-827e-2f6a641239df</entry>
Apr 13 19:05:44 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:05:44 user nova-compute[71692]:     </system>
Apr 13 19:05:44 user nova-compute[71692]:   </sysinfo>
Apr 13 19:05:44 user nova-compute[71692]:   <os>
Apr 13 19:05:44 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:05:44 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:05:44 user nova-compute[71692]:   </os>
Apr 13 19:05:44 user nova-compute[71692]:   <features>
Apr 13 19:05:44 user nova-compute[71692]:     <acpi/>
Apr 13 19:05:44 user nova-compute[71692]:     <apic/>
Apr 13 19:05:44 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:05:44 user nova-compute[71692]:   </features>
Apr 13 19:05:44 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:05:44 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:05:44 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:05:44 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:05:44 user nova-compute[71692]:   </clock>
Apr 13 19:05:44 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:05:44 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:05:44 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:05:44 user nova-compute[71692]:   </cpu>
Apr 13 19:05:44 user nova-compute[71692]:   <devices>
Apr 13 19:05:44 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:05:44 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:05:44 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue"/>
Apr 13 19:05:44 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:05:44 user nova-compute[71692]:     </disk>
Apr 13 19:05:44 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:05:44 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:05:44 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk"/>
Apr 13 19:05:44 user nova-compute[71692]:       <target dev="vdb" bus="virtio"/>
Apr 13 19:05:44 user nova-compute[71692]:     </disk>
Apr 13 19:05:44 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:05:44 user nova-compute[71692]:       <mac address="fa:16:3e:de:c1:80"/>
Apr 13 19:05:44 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:05:44 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:05:44 user nova-compute[71692]:       <target dev="tap3de4b459-2a"/>
Apr 13 19:05:44 user nova-compute[71692]:     </interface>
Apr 13 19:05:44 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:05:44 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/console.log" append="off"/>
Apr 13 19:05:44 user nova-compute[71692]:     </serial>
Apr 13 19:05:44 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:05:44 user nova-compute[71692]:     <video>
Apr 13 19:05:44 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:05:44 user nova-compute[71692]:     </video>
Apr 13 19:05:44 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:05:44 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:05:44 user nova-compute[71692]:     </rng>
Apr 13 19:05:44 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:05:44 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:05:44 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:05:44 user nova-compute[71692]:     </memballoon>
Apr 13 19:05:44 user nova-compute[71692]:   </devices>
Apr 13 19:05:44 user nova-compute[71692]: </domain>
Apr 13 19:05:44 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:05:44 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Instance destroyed successfully.
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:05:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No VIF found with MAC fa:16:3e:de:c1:80, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:05:45 user nova-compute[71692]: DEBUG nova.compute.manager [req-499c50cb-d6f9-4baa-a6df-e1c6110fb9e0 req-e088fe3d-fb8e-4cd8-bb1a-0a37741984a1 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received event network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:05:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-499c50cb-d6f9-4baa-a6df-e1c6110fb9e0 req-e088fe3d-fb8e-4cd8-bb1a-0a37741984a1 service nova] Acquiring lock "59d7b86a-c723-4255-827e-2f6a641239df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-499c50cb-d6f9-4baa-a6df-e1c6110fb9e0 req-e088fe3d-fb8e-4cd8-bb1a-0a37741984a1 service nova] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-499c50cb-d6f9-4baa-a6df-e1c6110fb9e0 req-e088fe3d-fb8e-4cd8-bb1a-0a37741984a1 service nova] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:45 user nova-compute[71692]: DEBUG nova.compute.manager [req-499c50cb-d6f9-4baa-a6df-e1c6110fb9e0 req-e088fe3d-fb8e-4cd8-bb1a-0a37741984a1 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] No waiting events found dispatching network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:05:45 user nova-compute[71692]: WARNING nova.compute.manager [req-499c50cb-d6f9-4baa-a6df-e1c6110fb9e0 req-e088fe3d-fb8e-4cd8-bb1a-0a37741984a1 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received unexpected event network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 for instance with vm_state active and task_state rescuing.
Apr 13 19:05:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Starting finish_migration {{(pid=71692) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 13 19:05:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Instance directory exists: not creating {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 19:05:45 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Creating image(s)
Apr 13 19:05:45 user nova-compute[71692]: DEBUG nova.objects.instance [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'trusted_certs' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:05:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:45 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:05:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Cannot resize image /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Did not create local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Ensure instance console log exists: /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Start _get_guest_xml network_info=[{"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-383984590-network", "vif_mac": "fa:16:3e:bc:71:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '4f9883f8-f29a-4392-94a4-5d51a94480cd', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyHemtYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8', 'attached_at': '2023-04-13T19:05:46.000000', 'detached_at': '', 'volume_id': '50a307e4-f870-4d27-ba29-f61e22e6a414', 'serial': '50a307e4-f870-4d27-ba29-f61e22e6a414'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:05:46 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:05:46 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:54:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.objects.instance [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'vcpu_model' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyHemtYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:05:46 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:05:46 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:05:46 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5b01fc-8420-4f56-bef3-07a7f73a268f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:05:46 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[137a815b-7745-46d8-8b00-ce8c15a71434]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414] added
Apr 13 19:05:46 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e03063-bdb5-479f-9ec0-5b1ad0012de5]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73c4350-80fd-4231-90e6-514e2126c59f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dyHemtYs {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dyHemtYs" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9be1736-c5fa-461e-ae27-cb62aa1e941c]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dyHemtYs'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea0ee38-668d-4a4b-9900-5c4aea574cf5]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8702e9-035f-4d0d-85d0-96539cc87c25]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 19:05:46 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 19:05:46 user nova-compute[71692]:  {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:05:46 user nova-compute[71692]: WARNING os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 19:05:46 user nova-compute[71692]: 
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c58ffb-d2ff-489b-bf05-103819a4b6ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260]
Apr 13 19:05:46 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260] successful.
Apr 13 19:05:46 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7f5203-2ec4-4bd9-81ca-102dd86feff0]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef12d244-1363-4c83-b8b1-7370265a68de]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:05:46 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:05:46 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a61c761-4334-498b-a90a-2264a9fb1398]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:05:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyHemtYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23763326537656531', 'path': '/dev/sdb'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763326537656531', 'path': '/dev/sdb'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T18:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-657008190',display_name='tempest-ServerActionsTestJSON-server-1417744922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-657008190',id=5,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:00:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-zw23yzik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:05:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-383984590-network", "vif_mac": "fa:16:3e:bc:71:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-383984590-network", "vif_mac": "fa:16:3e:bc:71:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:05:47 user nova-compute[71692]:   <uuid>b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8</uuid>
Apr 13 19:05:47 user nova-compute[71692]:   <name>instance-00000005</name>
Apr 13 19:05:47 user nova-compute[71692]:   <memory>196608</memory>
Apr 13 19:05:47 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:05:47 user nova-compute[71692]:   <metadata>
Apr 13 19:05:47 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:05:47 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:05:47 user nova-compute[71692]:       <nova:name>tempest-ServerActionsTestJSON-server-1417744922</nova:name>
Apr 13 19:05:47 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:05:46</nova:creationTime>
Apr 13 19:05:47 user nova-compute[71692]:       <nova:flavor name="m1.micro">
Apr 13 19:05:47 user nova-compute[71692]:         <nova:memory>192</nova:memory>
Apr 13 19:05:47 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:05:47 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:05:47 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:05:47 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:05:47 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:05:47 user nova-compute[71692]:       <nova:owner>
Apr 13 19:05:47 user nova-compute[71692]:         <nova:user uuid="df209814208d415e9d414d39205aaad6">tempest-ServerActionsTestJSON-1901931474-project-member</nova:user>
Apr 13 19:05:47 user nova-compute[71692]:         <nova:project uuid="c162f91cba4b4ecf9de48fbf839da261">tempest-ServerActionsTestJSON-1901931474</nova:project>
Apr 13 19:05:47 user nova-compute[71692]:       </nova:owner>
Apr 13 19:05:47 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:05:47 user nova-compute[71692]:       <nova:ports>
Apr 13 19:05:47 user nova-compute[71692]:         <nova:port uuid="2b297ca1-e672-438a-917a-df2319262bc0">
Apr 13 19:05:47 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 19:05:47 user nova-compute[71692]:         </nova:port>
Apr 13 19:05:47 user nova-compute[71692]:       </nova:ports>
Apr 13 19:05:47 user nova-compute[71692]:     </nova:instance>
Apr 13 19:05:47 user nova-compute[71692]:   </metadata>
Apr 13 19:05:47 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:05:47 user nova-compute[71692]:     <system>
Apr 13 19:05:47 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:05:47 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:05:47 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:05:47 user nova-compute[71692]:       <entry name="serial">b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8</entry>
Apr 13 19:05:47 user nova-compute[71692]:       <entry name="uuid">b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8</entry>
Apr 13 19:05:47 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:05:47 user nova-compute[71692]:     </system>
Apr 13 19:05:47 user nova-compute[71692]:   </sysinfo>
Apr 13 19:05:47 user nova-compute[71692]:   <os>
Apr 13 19:05:47 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:05:47 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:05:47 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:05:47 user nova-compute[71692]:   </os>
Apr 13 19:05:47 user nova-compute[71692]:   <features>
Apr 13 19:05:47 user nova-compute[71692]:     <acpi/>
Apr 13 19:05:47 user nova-compute[71692]:     <apic/>
Apr 13 19:05:47 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:05:47 user nova-compute[71692]:   </features>
Apr 13 19:05:47 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:05:47 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:05:47 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:05:47 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:05:47 user nova-compute[71692]:   </clock>
Apr 13 19:05:47 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:05:47 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:05:47 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:05:47 user nova-compute[71692]:   </cpu>
Apr 13 19:05:47 user nova-compute[71692]:   <devices>
Apr 13 19:05:47 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:05:47 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:05:47 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk"/>
Apr 13 19:05:47 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:05:47 user nova-compute[71692]:     </disk>
Apr 13 19:05:47 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:05:47 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:05:47 user nova-compute[71692]:       <source dev="/dev/sdb"/>
Apr 13 19:05:47 user nova-compute[71692]:       <target dev="vdb" bus="virtio"/>
Apr 13 19:05:47 user nova-compute[71692]:       <serial>50a307e4-f870-4d27-ba29-f61e22e6a414</serial>
Apr 13 19:05:47 user nova-compute[71692]:     </disk>
Apr 13 19:05:47 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:05:47 user nova-compute[71692]:       <mac address="fa:16:3e:bc:71:09"/>
Apr 13 19:05:47 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:05:47 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:05:47 user nova-compute[71692]:       <target dev="tap2b297ca1-e6"/>
Apr 13 19:05:47 user nova-compute[71692]:     </interface>
Apr 13 19:05:47 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:05:47 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/console.log" append="off"/>
Apr 13 19:05:47 user nova-compute[71692]:     </serial>
Apr 13 19:05:47 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:05:47 user nova-compute[71692]:     <video>
Apr 13 19:05:47 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:05:47 user nova-compute[71692]:     </video>
Apr 13 19:05:47 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:05:47 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:05:47 user nova-compute[71692]:     </rng>
Apr 13 19:05:47 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:05:47 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:05:47 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:05:47 user nova-compute[71692]:     </memballoon>
Apr 13 19:05:47 user nova-compute[71692]:   </devices>
Apr 13 19:05:47 user nova-compute[71692]: </domain>
Apr 13 19:05:47 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T18:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-657008190',display_name='tempest-ServerActionsTestJSON-server-1417744922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-657008190',id=5,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:00:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-zw23yzik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:05:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-383984590-network", "vif_mac": "fa:16:3e:bc:71:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-383984590-network", "vif_mac": "fa:16:3e:bc:71:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG os_vif [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b297ca1-e6, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b297ca1-e6, col_values=(('external_ids', {'iface-id': '2b297ca1-e672-438a-917a-df2319262bc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:71:09', 'vm-uuid': 'b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:47 user nova-compute[71692]: INFO os_vif [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6')
Apr 13 19:05:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No VIF found with MAC fa:16:3e:bc:71:09, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received event network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] Acquiring lock "59d7b86a-c723-4255-827e-2f6a641239df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] No waiting events found dispatching network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:05:47 user nova-compute[71692]: WARNING nova.compute.manager [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received unexpected event network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 for instance with vm_state active and task_state rescuing.
Apr 13 19:05:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received event network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] Acquiring lock "59d7b86a-c723-4255-827e-2f6a641239df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] No waiting events found dispatching network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:05:47 user nova-compute[71692]: WARNING nova.compute.manager [req-b340b010-d59c-41df-8d49-ae8fa4af0629 req-289b9d52-c604-4490-8a2b-bc32348d7524 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received unexpected event network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 for instance with vm_state active and task_state rescuing.
Apr 13 19:05:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Removed pending event for 59d7b86a-c723-4255-827e-2f6a641239df due to event {{(pid=71692) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 19:05:48 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412748.1636467, 59d7b86a-c723-4255-827e-2f6a641239df => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:05:48 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] VM Resumed (Lifecycle Event)
Apr 13 19:05:48 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ec5dc1f9-79cf-4fd0-bbf6-70e108ec4602 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:05:48 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:05:48 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:05:48 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 19:05:48 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412748.1653001, 59d7b86a-c723-4255-827e-2f6a641239df => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:05:48 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] VM Started (Lifecycle Event)
Apr 13 19:05:48 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:05:48 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:05:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:49 user nova-compute[71692]: DEBUG nova.compute.manager [req-30b87a39-2aa1-43f2-bb78-dc508bf1b14c req-8eaaaa23-5da3-40dc-9939-349bfe59ffe2 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:05:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-30b87a39-2aa1-43f2-bb78-dc508bf1b14c req-8eaaaa23-5da3-40dc-9939-349bfe59ffe2 service nova] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-30b87a39-2aa1-43f2-bb78-dc508bf1b14c req-8eaaaa23-5da3-40dc-9939-349bfe59ffe2 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-30b87a39-2aa1-43f2-bb78-dc508bf1b14c req-8eaaaa23-5da3-40dc-9939-349bfe59ffe2 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:49 user nova-compute[71692]: DEBUG nova.compute.manager [req-30b87a39-2aa1-43f2-bb78-dc508bf1b14c req-8eaaaa23-5da3-40dc-9939-349bfe59ffe2 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] No waiting events found dispatching network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:05:49 user nova-compute[71692]: WARNING nova.compute.manager [req-30b87a39-2aa1-43f2-bb78-dc508bf1b14c req-8eaaaa23-5da3-40dc-9939-349bfe59ffe2 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received unexpected event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 for instance with vm_state active and task_state resize_finish.
Apr 13 19:05:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Removed pending event for b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 due to event {{(pid=71692) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 19:05:51 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412751.4309754, b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:05:51 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] VM Resumed (Lifecycle Event)
Apr 13 19:05:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:05:51 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Instance running successfully.
Apr 13 19:05:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:05:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Failed to set time: agent not configured {{(pid=71692) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 13 19:05:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-548b0a39-acde-4597-b68d-5edb035ca4b8 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] finish_migration finished successfully. {{(pid=71692) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 13 19:05:51 user nova-compute[71692]: DEBUG nova.compute.manager [req-07520b27-4245-4a1d-a26a-c2e7db53ab14 req-8e067ac2-e945-4d58-9ea6-105b8ece9a3d service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:05:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-07520b27-4245-4a1d-a26a-c2e7db53ab14 req-8e067ac2-e945-4d58-9ea6-105b8ece9a3d service nova] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:05:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-07520b27-4245-4a1d-a26a-c2e7db53ab14 req-8e067ac2-e945-4d58-9ea6-105b8ece9a3d service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:05:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-07520b27-4245-4a1d-a26a-c2e7db53ab14 req-8e067ac2-e945-4d58-9ea6-105b8ece9a3d service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:05:51 user nova-compute[71692]: DEBUG nova.compute.manager [req-07520b27-4245-4a1d-a26a-c2e7db53ab14 req-8e067ac2-e945-4d58-9ea6-105b8ece9a3d service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] No waiting events found dispatching network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:05:51 user nova-compute[71692]: WARNING nova.compute.manager [req-07520b27-4245-4a1d-a26a-c2e7db53ab14 req-8e067ac2-e945-4d58-9ea6-105b8ece9a3d service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received unexpected event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 for instance with vm_state active and task_state resize_finish.
Apr 13 19:05:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:05:51 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 19:05:51 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412751.4346707, b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:05:51 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] VM Started (Lifecycle Event)
Apr 13 19:05:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:05:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:05:51 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 19:05:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:05:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-c12b20e9-7356-45f1-8295-503ea92e620f req-4e36c37a-bed4-4e65-9ba7-da50fe3cf76c service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-changed-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-c12b20e9-7356-45f1-8295-503ea92e620f req-4e36c37a-bed4-4e65-9ba7-da50fe3cf76c service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Refreshing instance network info cache due to event network-changed-071fd8c9-9400-42aa-ad88-1176bb1d4910. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:06:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c12b20e9-7356-45f1-8295-503ea92e620f req-4e36c37a-bed4-4e65-9ba7-da50fe3cf76c service nova] Acquiring lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:06:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c12b20e9-7356-45f1-8295-503ea92e620f req-4e36c37a-bed4-4e65-9ba7-da50fe3cf76c service nova] Acquired lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:06:01 user nova-compute[71692]: DEBUG nova.network.neutron [req-c12b20e9-7356-45f1-8295-503ea92e620f req-4e36c37a-bed4-4e65-9ba7-da50fe3cf76c service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Refreshing network info cache for port 071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:06:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:01 user nova-compute[71692]: DEBUG nova.network.neutron [req-c12b20e9-7356-45f1-8295-503ea92e620f req-4e36c37a-bed4-4e65-9ba7-da50fe3cf76c service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Updated VIF entry in instance network info cache for port 071fd8c9-9400-42aa-ad88-1176bb1d4910. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:06:01 user nova-compute[71692]: DEBUG nova.network.neutron [req-c12b20e9-7356-45f1-8295-503ea92e620f req-4e36c37a-bed4-4e65-9ba7-da50fe3cf76c service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Updating instance_info_cache with network_info: [{"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:06:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c12b20e9-7356-45f1-8295-503ea92e620f req-4e36c37a-bed4-4e65-9ba7-da50fe3cf76c service nova] Releasing lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:06:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:02 user nova-compute[71692]: INFO nova.compute.manager [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Terminating instance
Apr 13 19:06:02 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG nova.compute.manager [req-5483cc0c-6c5e-4518-b04a-c3c5cf1b09f2 req-e19619d6-b276-49fb-984a-44b8937c5e78 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received event network-vif-unplugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5483cc0c-6c5e-4518-b04a-c3c5cf1b09f2 req-e19619d6-b276-49fb-984a-44b8937c5e78 service nova] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5483cc0c-6c5e-4518-b04a-c3c5cf1b09f2 req-e19619d6-b276-49fb-984a-44b8937c5e78 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5483cc0c-6c5e-4518-b04a-c3c5cf1b09f2 req-e19619d6-b276-49fb-984a-44b8937c5e78 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG nova.compute.manager [req-5483cc0c-6c5e-4518-b04a-c3c5cf1b09f2 req-e19619d6-b276-49fb-984a-44b8937c5e78 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] No waiting events found dispatching network-vif-unplugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG nova.compute.manager [req-5483cc0c-6c5e-4518-b04a-c3c5cf1b09f2 req-e19619d6-b276-49fb-984a-44b8937c5e78 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received event network-vif-unplugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:03 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Instance destroyed successfully.
Apr 13 19:06:03 user nova-compute[71692]: DEBUG nova.objects.instance [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'resources' on Instance uuid a15c1b5e-1769-490a-b81f-09333cd4a227 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T18:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-401678638',display_name='tempest-AttachVolumeTestJSON-server-401678638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-401678638',id=2,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE5B1S6SqZNLSYUvXCtLzlE03oQZAx0ezu9QmfHUm/VQFyAV9bhAsOFjrmYjBIjMOSTPvvajdVY1JHSqXEdUecpJFgE/NvFW0y7bhYdRssG3xIWyUJMMg1figOyi2kGeg==',key_name='tempest-keypair-1245494573',keypairs=<?>,launch_index=0,launched_at=2023-04-13T18:56:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63b52d6508154a918a13b31712b32796',ramdisk_id='',reservation_id='r-ecb50eo5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-43043273',owner_user_name='tempest-AttachVolumeTestJSON-43043273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:04:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba70f34af8664dc89fd9851d00d5b96d',uuid=a15c1b5e-1769-490a-b81f-09333cd4a227,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converting VIF {"id": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "address": "fa:16:3e:7b:3b:25", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9907d23-58", "ovs_interfaceid": "a9907d23-585e-46b6-935d-d2d1f7d840f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG os_vif [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9907d23-58, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:03 user nova-compute[71692]: INFO os_vif [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:3b:25,bridge_name='br-int',has_traffic_filtering=True,id=a9907d23-585e-46b6-935d-d2d1f7d840f2,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9907d23-58')
Apr 13 19:06:03 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Deleting instance files /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227_del
Apr 13 19:06:03 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Deletion of /opt/stack/data/nova/instances/a15c1b5e-1769-490a-b81f-09333cd4a227_del complete
Apr 13 19:06:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:03 user nova-compute[71692]: INFO nova.compute.manager [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Shelving
Apr 13 19:06:03 user nova-compute[71692]: INFO nova.compute.manager [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 13 19:06:03 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-a0f87b98-fd19-48ee-9ac8-36015618f887 req-cab10a9d-41bd-4ed4-a3f9-0386c89f4c12 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-vif-unplugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a0f87b98-fd19-48ee-9ac8-36015618f887 req-cab10a9d-41bd-4ed4-a3f9-0386c89f4c12 service nova] Acquiring lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a0f87b98-fd19-48ee-9ac8-36015618f887 req-cab10a9d-41bd-4ed4-a3f9-0386c89f4c12 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a0f87b98-fd19-48ee-9ac8-36015618f887 req-cab10a9d-41bd-4ed4-a3f9-0386c89f4c12 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-a0f87b98-fd19-48ee-9ac8-36015618f887 req-cab10a9d-41bd-4ed4-a3f9-0386c89f4c12 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] No waiting events found dispatching network-vif-unplugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:04 user nova-compute[71692]: WARNING nova.compute.manager [req-a0f87b98-fd19-48ee-9ac8-36015618f887 req-cab10a9d-41bd-4ed4-a3f9-0386c89f4c12 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received unexpected event network-vif-unplugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance with vm_state active and task_state shelving.
Apr 13 19:06:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:04 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Instance destroyed successfully.
Apr 13 19:06:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:04 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Beginning cold snapshot process
Apr 13 19:06:04 user nova-compute[71692]: DEBUG nova.privsep.utils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 19:06:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk /opt/stack/data/nova/instances/snapshots/tmpoxr6bsv4/6f07dfc9123f44f292ec60a465b5172c {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:05 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:06:05 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Took 1.28 seconds to deallocate network for instance.
Apr 13 19:06:05 user nova-compute[71692]: DEBUG nova.compute.manager [req-517cdd89-d4a4-47c3-8981-ecde0b9d5d2f req-cce41dc7-f6b1-405c-b539-45cde530855f service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received event network-vif-deleted-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk /opt/stack/data/nova/instances/snapshots/tmpoxr6bsv4/6f07dfc9123f44f292ec60a465b5172c" returned: 0 in 0.358s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:05 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Snapshot extracted, beginning image upload
Apr 13 19:06:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:05 user nova-compute[71692]: DEBUG nova.compute.manager [req-b100edf8-cd85-4e1a-abc6-3ef89d5b5fb5 req-4b6c277a-6220-4c38-a14a-bd3aa33a5f39 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b100edf8-cd85-4e1a-abc6-3ef89d5b5fb5 req-4b6c277a-6220-4c38-a14a-bd3aa33a5f39 service nova] Acquiring lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b100edf8-cd85-4e1a-abc6-3ef89d5b5fb5 req-4b6c277a-6220-4c38-a14a-bd3aa33a5f39 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b100edf8-cd85-4e1a-abc6-3ef89d5b5fb5 req-4b6c277a-6220-4c38-a14a-bd3aa33a5f39 service nova] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:05 user nova-compute[71692]: DEBUG nova.compute.manager [req-b100edf8-cd85-4e1a-abc6-3ef89d5b5fb5 req-4b6c277a-6220-4c38-a14a-bd3aa33a5f39 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] No waiting events found dispatching network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:05 user nova-compute[71692]: WARNING nova.compute.manager [req-b100edf8-cd85-4e1a-abc6-3ef89d5b5fb5 req-4b6c277a-6220-4c38-a14a-bd3aa33a5f39 service nova] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Received unexpected event network-vif-plugged-a9907d23-585e-46b6-935d-d2d1f7d840f2 for instance with vm_state deleted and task_state None.
Apr 13 19:06:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:05 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:06:05 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:06:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:05 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Deleted allocations for instance a15c1b5e-1769-490a-b81f-09333cd4a227
Apr 13 19:06:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f1e8914c-76a9-4e3c-8b5b-1021e0e02dba tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "a15c1b5e-1769-490a-b81f-09333cd4a227" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.814s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Acquiring lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] No waiting events found dispatching network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:06 user nova-compute[71692]: WARNING nova.compute.manager [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received unexpected event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 19:06:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Acquiring lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] No waiting events found dispatching network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:06 user nova-compute[71692]: WARNING nova.compute.manager [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received unexpected event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 19:06:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Acquiring lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] No waiting events found dispatching network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:06 user nova-compute[71692]: WARNING nova.compute.manager [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received unexpected event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 19:06:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-vif-unplugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Acquiring lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] No waiting events found dispatching network-vif-unplugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:06 user nova-compute[71692]: WARNING nova.compute.manager [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received unexpected event network-vif-unplugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 19:06:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Acquiring lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] No waiting events found dispatching network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:06 user nova-compute[71692]: WARNING nova.compute.manager [req-70d26d4f-6258-420a-8fb8-b99a4f0b958d req-a66631e9-45c9-40d9-900e-23a2eeed8d37 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received unexpected event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 19:06:07 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Snapshot image upload complete
Apr 13 19:06:07 user nova-compute[71692]: DEBUG nova.compute.manager [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:06:07 user nova-compute[71692]: INFO nova.compute.manager [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Shelve offloading
Apr 13 19:06:07 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Instance destroyed successfully.
Apr 13 19:06:07 user nova-compute[71692]: DEBUG nova.compute.manager [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:06:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:06:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquired lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:06:07 user nova-compute[71692]: DEBUG nova.network.neutron [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:06:08 user nova-compute[71692]: DEBUG nova.network.neutron [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Updating instance_info_cache with network_info: [{"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:06:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Releasing lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:06:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:09 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Instance destroyed successfully.
Apr 13 19:06:09 user nova-compute[71692]: DEBUG nova.objects.instance [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'resources' on Instance uuid 2c2e4899-d6d5-422c-a4f1-61a8129abdae {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1141253084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1141253084',id=16,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZe8WHxNPt+OEFTfKSkzy8wZuScIjzJeyBVbA3Z02RJMRIdLJty1zSrwoxsbVtyU7kpmUkL2gYS28J8h+WxdhP9nXELXUDvHj2w4B2VNtkzNPMfJnxeWpbUzlRv0BK2Kg==',key_name='tempest-keypair-1280930280',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:04:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='faabdcc8e61c452ab3b934b1c9501e68',ramdisk_id='',reservation_id='r-r0g030ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1546308967',owner_user_name='tempest-AttachVolumeShelveTestJSON-1546308967-project-member',shelved_at='2023-04-13T19:06:07.645777',shelved_host='user',shelved_image_id='80bef666-ea86-4e4b-94a6-dad9533d2d25'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee6c76c605d54b4f84e0596b27087f0b',uuid=2c2e4899-d6d5-422c-a4f1-61a8129abdae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converting VIF {"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:dd:1f,bridge_name='br-int',has_traffic_filtering=True,id=071fd8c9-9400-42aa-ad88-1176bb1d4910,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071fd8c9-94') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG os_vif [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:dd:1f,bridge_name='br-int',has_traffic_filtering=True,id=071fd8c9-9400-42aa-ad88-1176bb1d4910,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071fd8c9-94') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap071fd8c9-94, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:06:09 user nova-compute[71692]: INFO os_vif [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:dd:1f,bridge_name='br-int',has_traffic_filtering=True,id=071fd8c9-9400-42aa-ad88-1176bb1d4910,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071fd8c9-94')
Apr 13 19:06:09 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Deleting instance files /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae_del
Apr 13 19:06:09 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Deletion of /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae_del complete
Apr 13 19:06:09 user nova-compute[71692]: DEBUG nova.compute.manager [req-216b3859-6e02-47f4-9cef-d37052d7ed22 req-f122da5e-b959-42a0-8b65-e61e2e74df24 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-changed-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG nova.compute.manager [req-216b3859-6e02-47f4-9cef-d37052d7ed22 req-f122da5e-b959-42a0-8b65-e61e2e74df24 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Refreshing instance network info cache due to event network-changed-071fd8c9-9400-42aa-ad88-1176bb1d4910. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-216b3859-6e02-47f4-9cef-d37052d7ed22 req-f122da5e-b959-42a0-8b65-e61e2e74df24 service nova] Acquiring lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-216b3859-6e02-47f4-9cef-d37052d7ed22 req-f122da5e-b959-42a0-8b65-e61e2e74df24 service nova] Acquired lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG nova.network.neutron [req-216b3859-6e02-47f4-9cef-d37052d7ed22 req-f122da5e-b959-42a0-8b65-e61e2e74df24 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Refreshing network info cache for port 071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:06:09 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Deleted allocations for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae
Apr 13 19:06:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG nova.objects.instance [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'numa_topology' on Instance uuid 2c2e4899-d6d5-422c-a4f1-61a8129abdae {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-658cdc16-1785-42e9-b97e-1ca62a1b6b01 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.927s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG nova.network.neutron [req-216b3859-6e02-47f4-9cef-d37052d7ed22 req-f122da5e-b959-42a0-8b65-e61e2e74df24 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Updated VIF entry in instance network info cache for port 071fd8c9-9400-42aa-ad88-1176bb1d4910. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG nova.network.neutron [req-216b3859-6e02-47f4-9cef-d37052d7ed22 req-f122da5e-b959-42a0-8b65-e61e2e74df24 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Updating instance_info_cache with network_info: [{"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap071fd8c9-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:06:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-216b3859-6e02-47f4-9cef-d37052d7ed22 req-f122da5e-b959-42a0-8b65-e61e2e74df24 service nova] Releasing lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:06:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:16 user nova-compute[71692]: DEBUG nova.compute.manager [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:06:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:16 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:06:16 user nova-compute[71692]: INFO nova.compute.claims [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Claim successful on node user
Apr 13 19:06:16 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:06:16 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:06:17 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:06:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:06:17 user nova-compute[71692]: INFO nova.virt.block_device [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Booting with volume 5e14c389-bd5a-4d04-aa08-2c6733b87b8b at /dev/vda
Apr 13 19:06:17 user nova-compute[71692]: DEBUG os_brick.utils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5db37c-f4a6-463e-a4d7-0a287e152a7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d556cbc6-3d4c-4073-82f0-77f9e2c10a84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[08373f97-0ab4-4775-9e70-fdb29478b37c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bab095-6c6b-4ecf-9958-cdf2fad1d88b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG nova.policy [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8649dbc1659844ef9b98ae022beda26a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8f6086043e47289bafbe341f3379d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:06:17 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:06:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afcef13-f980-45ea-887a-1c5de477efcc]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG os_brick.utils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:06:17 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updating existing volume attachment record: 8d326155-b465-4484-842e-ecee9a9d5d4d {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:06:18 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Successfully created port: 28b89f9c-8af3-4c33-89a9-55c61aaafe03 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:06:18 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Successfully created port: ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:06:18 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412763.6924813, a15c1b5e-1769-490a-b81f-09333cd4a227 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:06:18 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] VM Stopped (Lifecycle Event)
Apr 13 19:06:18 user nova-compute[71692]: DEBUG nova.compute.manager [None req-4de7088d-c133-4875-a28d-fb6edb79657e None None] [instance: a15c1b5e-1769-490a-b81f-09333cd4a227] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:06:19 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Successfully created port: e0eb0dff-32a5-4b83-a302-b1293d0effdc {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:06:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:19 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412764.6058853, 2c2e4899-d6d5-422c-a4f1-61a8129abdae => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:06:19 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] VM Stopped (Lifecycle Event)
Apr 13 19:06:19 user nova-compute[71692]: DEBUG nova.compute.manager [None req-933df651-3adf-4eac-8e60-414ae66f1dfa None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:06:19 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Successfully created port: be95859a-0075-4a7d-b4f3-c89c61e54984 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:06:20 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Successfully created port: 5d35454b-179a-4fcc-a56d-445475aa2900 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:06:21 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Successfully updated port: 28b89f9c-8af3-4c33-89a9-55c61aaafe03 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:06:21 user nova-compute[71692]: DEBUG nova.compute.manager [req-489596f7-5786-4ae3-9ad9-3412f1d91fd3 req-139fdc94-e86b-4e94-828f-65f7348c39e3 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-changed-28b89f9c-8af3-4c33-89a9-55c61aaafe03 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:21 user nova-compute[71692]: DEBUG nova.compute.manager [req-489596f7-5786-4ae3-9ad9-3412f1d91fd3 req-139fdc94-e86b-4e94-828f-65f7348c39e3 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Refreshing instance network info cache due to event network-changed-28b89f9c-8af3-4c33-89a9-55c61aaafe03. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:06:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-489596f7-5786-4ae3-9ad9-3412f1d91fd3 req-139fdc94-e86b-4e94-828f-65f7348c39e3 service nova] Acquiring lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:06:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-489596f7-5786-4ae3-9ad9-3412f1d91fd3 req-139fdc94-e86b-4e94-828f-65f7348c39e3 service nova] Acquired lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:06:21 user nova-compute[71692]: DEBUG nova.network.neutron [req-489596f7-5786-4ae3-9ad9-3412f1d91fd3 req-139fdc94-e86b-4e94-828f-65f7348c39e3 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Refreshing network info cache for port 28b89f9c-8af3-4c33-89a9-55c61aaafe03 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:06:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:21 user nova-compute[71692]: DEBUG nova.network.neutron [req-489596f7-5786-4ae3-9ad9-3412f1d91fd3 req-139fdc94-e86b-4e94-828f-65f7348c39e3 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:06:21 user nova-compute[71692]: DEBUG nova.network.neutron [req-489596f7-5786-4ae3-9ad9-3412f1d91fd3 req-139fdc94-e86b-4e94-828f-65f7348c39e3 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:06:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-489596f7-5786-4ae3-9ad9-3412f1d91fd3 req-139fdc94-e86b-4e94-828f-65f7348c39e3 service nova] Releasing lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:06:21 user nova-compute[71692]: INFO nova.virt.block_device [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Booting with volume 12c42f5e-32d2-4365-b2e4-096988f7b407 at /dev/vdb
Apr 13 19:06:22 user nova-compute[71692]: DEBUG os_brick.utils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[897710fc-ea3d-476f-a4ba-61a9d75409ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cad311-906b-41a0-b496-dd25f33123a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fe73a7-cce7-4114-9949-7db3d25b4221]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[616b1044-ae51-4214-b1a1-83b79a352f80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Successfully updated port: 1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:06:22 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:06:22 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb514413-5308-4674-b095-7d9b0c95d0b2]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG os_brick.utils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updating existing volume attachment record: 6f3aebf6-9f3f-4001-a980-bf13f2937956 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:06:22 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Successfully updated port: d4f7e511-017c-4a16-8e0c-21f468f87027 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:06:23 user nova-compute[71692]: DEBUG nova.compute.manager [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-changed-1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:23 user nova-compute[71692]: DEBUG nova.compute.manager [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Refreshing instance network info cache due to event network-changed-1ea157b6-07a2-4ff3-b11f-b7ea88de6e12. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:06:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] Acquiring lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:06:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] Acquired lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:06:23 user nova-compute[71692]: DEBUG nova.network.neutron [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Refreshing network info cache for port 1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:06:23 user nova-compute[71692]: DEBUG nova.network.neutron [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:06:23 user nova-compute[71692]: DEBUG nova.network.neutron [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:06:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] Releasing lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:06:23 user nova-compute[71692]: DEBUG nova.compute.manager [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-changed-d4f7e511-017c-4a16-8e0c-21f468f87027 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:23 user nova-compute[71692]: DEBUG nova.compute.manager [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Refreshing instance network info cache due to event network-changed-d4f7e511-017c-4a16-8e0c-21f468f87027. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:06:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] Acquiring lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:06:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] Acquired lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:06:23 user nova-compute[71692]: DEBUG nova.network.neutron [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Refreshing network info cache for port d4f7e511-017c-4a16-8e0c-21f468f87027 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:06:23 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Successfully updated port: ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:06:23 user nova-compute[71692]: DEBUG nova.network.neutron [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:06:24 user nova-compute[71692]: DEBUG nova.network.neutron [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:06:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dd6bbaa4-bff1-4075-8033-4d75057d72e3 req-e1ad77dc-c10a-40d9-878b-0a4c27c5073e service nova] Releasing lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:06:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:24 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Successfully updated port: e0eb0dff-32a5-4b83-a302-b1293d0effdc {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:06:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Successfully updated port: be95859a-0075-4a7d-b4f3-c89c61e54984 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG nova.compute.manager [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-changed-ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG nova.compute.manager [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Refreshing instance network info cache due to event network-changed-ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] Acquiring lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] Acquired lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG nova.network.neutron [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Refreshing network info cache for port ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG nova.network.neutron [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG nova.network.neutron [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] Releasing lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG nova.compute.manager [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-changed-e0eb0dff-32a5-4b83-a302-b1293d0effdc {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG nova.compute.manager [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Refreshing instance network info cache due to event network-changed-e0eb0dff-32a5-4b83-a302-b1293d0effdc. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] Acquiring lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] Acquired lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG nova.network.neutron [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Refreshing network info cache for port e0eb0dff-32a5-4b83-a302-b1293d0effdc {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG nova.network.neutron [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Successfully updated port: 5d35454b-179a-4fcc-a56d-445475aa2900 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG nova.network.neutron [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] Releasing lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG nova.compute.manager [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-changed-be95859a-0075-4a7d-b4f3-c89c61e54984 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG nova.compute.manager [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Refreshing instance network info cache due to event network-changed-be95859a-0075-4a7d-b4f3-c89c61e54984. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] Acquiring lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] Acquired lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:06:25 user nova-compute[71692]: DEBUG nova.network.neutron [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Refreshing network info cache for port be95859a-0075-4a7d-b4f3-c89c61e54984 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:06:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:06:26 user nova-compute[71692]: DEBUG nova.network.neutron [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:06:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:26 user nova-compute[71692]: DEBUG nova.network.neutron [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:06:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-847037fe-822c-4afc-ad0f-90febad35770 req-12d4a379-35c1-4310-8be6-17ffdbc9f411 service nova] Releasing lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:06:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquired lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:06:26 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:06:26 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:06:26 user nova-compute[71692]: INFO nova.virt.block_device [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Booting with volume 304fa834-218d-40d5-a6d1-3b17810e41d7 at /dev/vdc
Apr 13 19:06:26 user nova-compute[71692]: DEBUG os_brick.utils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:06:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[330cbd8b-3153-40ae-903b-eca4691aa7d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03b55aa-e657-46e0-894b-c8b0ccf9b2a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b806691c-ed59-47c5-a4e4-31843f51054b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9602460-c3aa-4f68-9c17-a1b9c4a2cdba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:06:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:06:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:06:27 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:06:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f42e7c-d2d3-4f0b-97a8-9a4dc0ef54e3]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:06:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:06:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:06:27 user nova-compute[71692]: DEBUG os_brick.utils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:06:27 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updating existing volume attachment record: 6b3f633f-c010-49a0-bed0-6a5a1a58304e {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:06:27 user nova-compute[71692]: DEBUG nova.compute.manager [req-ae37643a-9a38-4a8e-bdef-cc21fc5c7d08 req-7a31187b-976b-4b10-86e8-decfa66d0a0a service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-changed-5d35454b-179a-4fcc-a56d-445475aa2900 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:27 user nova-compute[71692]: DEBUG nova.compute.manager [req-ae37643a-9a38-4a8e-bdef-cc21fc5c7d08 req-7a31187b-976b-4b10-86e8-decfa66d0a0a service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Refreshing instance network info cache due to event network-changed-5d35454b-179a-4fcc-a56d-445475aa2900. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:06:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ae37643a-9a38-4a8e-bdef-cc21fc5c7d08 req-7a31187b-976b-4b10-86e8-decfa66d0a0a service nova] Acquiring lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:06:28 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updating instance_info_cache with network_info: [{"id": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "address": "fa:16:3e:5f:cd:f6", "network": {"id": "63a9c9d2-0f2a-4643-b048-dcf2389044cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1932742453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b89f9c-8a", "ovs_interfaceid": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "address": "fa:16:3e:07:f8:b3", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea157b6-07", "ovs_interfaceid": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4f7e511-017c-4a16-8e0c-21f468f87027", "address": "fa:16:3e:4c:50:43", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7e511-01", "ovs_interfaceid": "d4f7e511-017c-4a16-8e0c-21f468f87027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "address": "fa:16:3e:49:07:8e", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9534ad-df", "ovs_interfaceid": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "address": "fa:16:3e:44:c2:9d", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0eb0dff-32", "ovs_interfaceid": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be95859a-0075-4a7d-b4f3-c89c61e54984", "address": "fa:16:3e:1a:a0:c1", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe95859a-00", "ovs_interfaceid": "be95859a-0075-4a7d-b4f3-c89c61e54984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d35454b-179a-4fcc-a56d-445475aa2900", "address": "fa:16:3e:54:0a:10", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d35454b-17", "ovs_interfaceid": "5d35454b-179a-4fcc-a56d-445475aa2900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:06:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Releasing lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:06:28 user nova-compute[71692]: DEBUG nova.compute.manager [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Instance network_info: |[{"id": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "address": "fa:16:3e:5f:cd:f6", "network": {"id": "63a9c9d2-0f2a-4643-b048-dcf2389044cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1932742453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b89f9c-8a", "ovs_interfaceid": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "address": "fa:16:3e:07:f8:b3", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea157b6-07", "ovs_interfaceid": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4f7e511-017c-4a16-8e0c-21f468f87027", "address": "fa:16:3e:4c:50:43", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7e511-01", "ovs_interfaceid": "d4f7e511-017c-4a16-8e0c-21f468f87027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "address": "fa:16:3e:49:07:8e", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9534ad-df", "ovs_interfaceid": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "address": "fa:16:3e:44:c2:9d", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0eb0dff-32", "ovs_interfaceid": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be95859a-0075-4a7d-b4f3-c89c61e54984", "address": "fa:16:3e:1a:a0:c1", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe95859a-00", "ovs_interfaceid": "be95859a-0075-4a7d-b4f3-c89c61e54984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d35454b-179a-4fcc-a56d-445475aa2900", "address": "fa:16:3e:54:0a:10", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d35454b-17", "ovs_interfaceid": "5d35454b-179a-4fcc-a56d-445475aa2900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:06:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ae37643a-9a38-4a8e-bdef-cc21fc5c7d08 req-7a31187b-976b-4b10-86e8-decfa66d0a0a service nova] Acquired lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:06:28 user nova-compute[71692]: DEBUG nova.network.neutron [req-ae37643a-9a38-4a8e-bdef-cc21fc5c7d08 req-7a31187b-976b-4b10-86e8-decfa66d0a0a service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Refreshing network info cache for port 5d35454b-179a-4fcc-a56d-445475aa2900 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:06:29 user nova-compute[71692]: DEBUG nova.network.neutron [req-ae37643a-9a38-4a8e-bdef-cc21fc5c7d08 req-7a31187b-976b-4b10-86e8-decfa66d0a0a service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updated VIF entry in instance network info cache for port 5d35454b-179a-4fcc-a56d-445475aa2900. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:06:29 user nova-compute[71692]: DEBUG nova.network.neutron [req-ae37643a-9a38-4a8e-bdef-cc21fc5c7d08 req-7a31187b-976b-4b10-86e8-decfa66d0a0a service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updating instance_info_cache with network_info: [{"id": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "address": "fa:16:3e:5f:cd:f6", "network": {"id": "63a9c9d2-0f2a-4643-b048-dcf2389044cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1932742453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b89f9c-8a", "ovs_interfaceid": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "address": "fa:16:3e:07:f8:b3", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea157b6-07", "ovs_interfaceid": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4f7e511-017c-4a16-8e0c-21f468f87027", "address": "fa:16:3e:4c:50:43", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7e511-01", "ovs_interfaceid": "d4f7e511-017c-4a16-8e0c-21f468f87027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "address": "fa:16:3e:49:07:8e", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9534ad-df", "ovs_interfaceid": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "address": "fa:16:3e:44:c2:9d", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0eb0dff-32", "ovs_interfaceid": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be95859a-0075-4a7d-b4f3-c89c61e54984", "address": "fa:16:3e:1a:a0:c1", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe95859a-00", "ovs_interfaceid": "be95859a-0075-4a7d-b4f3-c89c61e54984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d35454b-179a-4fcc-a56d-445475aa2900", "address": "fa:16:3e:54:0a:10", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d35454b-17", "ovs_interfaceid": "5d35454b-179a-4fcc-a56d-445475aa2900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:06:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ae37643a-9a38-4a8e-bdef-cc21fc5c7d08 req-7a31187b-976b-4b10-86e8-decfa66d0a0a service nova] Releasing lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:06:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.compute.manager [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:06:31 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Creating image(s)
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Did not create local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Ensure instance console log exists: /opt/stack/data/nova/instances/4e2d4287-0adb-4045-b6e8-25095b5d3bbf/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Start _get_guest_xml network_info=[{"id": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "address": "fa:16:3e:5f:cd:f6", "network": {"id": "63a9c9d2-0f2a-4643-b048-dcf2389044cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1932742453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b89f9c-8a", "ovs_interfaceid": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "address": "fa:16:3e:07:f8:b3", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea157b6-07", "ovs_interfaceid": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4f7e511-017c-4a16-8e0c-21f468f87027", "address": "fa:16:3e:4c:50:43", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7e511-01", "ovs_interfaceid": "d4f7e511-017c-4a16-8e0c-21f468f87027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "address": "fa:16:3e:49:07:8e", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9534ad-df", "ovs_interfaceid": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "address": "fa:16:3e:44:c2:9d", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0eb0dff-32", "ovs_interfaceid": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be95859a-0075-4a7d-b4f3-c89c61e54984", "address": "fa:16:3e:1a:a0:c1", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe95859a-00", "ovs_interfaceid": "be95859a-0075-4a7d-b4f3-c89c61e54984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d35454b-179a-4fcc-a56d-445475aa2900", "address": "fa:16:3e:54:0a:10", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d35454b-17", "ovs_interfaceid": "5d35454b-179a-4fcc-a56d-445475aa2900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '8d326155-b465-4484-842e-ecee9a9d5d4d', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQVBZERi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4e2d4287-0adb-4045-b6e8-25095b5d3bbf', 'attached_at': '', 'detached_at': '', 'volume_id': '5e14c389-bd5a-4d04-aa08-2c6733b87b8b', 'serial': '5e14c389-bd5a-4d04-aa08-2c6733b87b8b'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 1, 'attachment_id': '6f3aebf6-9f3f-4001-a980-bf13f2937956', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krjIcgPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4e2d4287-0adb-4045-b6e8-25095b5d3bbf', 'attached_at': '', 'detached_at': '', 'volume_id': '12c42f5e-32d2-4365-b2e4-096988f7b407', 'serial': '12c42f5e-32d2-4365-b2e4-096988f7b407'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 2, 'attachment_id': '6b3f633f-c010-49a0-bed0-6a5a1a58304e', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNiTgBpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4e2d4287-0adb-4045-b6e8-25095b5d3bbf', 'attached_at': '', 'detached_at': '', 'volume_id': '304fa834-218d-40d5-a6d1-3b17810e41d7', 'serial': '304fa834-218d-40d5-a6d1-3b17810e41d7'}, 'mount_device': '/dev/vdc', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:06:31 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:06:31 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQVBZERi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:06:31 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:06:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:06:31 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:06:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:06:31 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:06:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[219bf461-be29-4b39-8f5a-dbc4e20f32e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:06:31 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed72315-7f01-48a8-abfb-804255b67ec3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b] added
Apr 13 19:06:31 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2ac1eb-541b-48a2-931c-44f1e5b39115]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc28706-3a5d-4bb6-8b91-f96f96fce002]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UQVBZERi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UQVBZERi" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[316432ab-1ad6-4feb-88af-d4d9b3f60a70]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UQVBZERi'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1470cb52-54ab-498a-9a7c-17b7fa7821a9]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[081bee9a-0822-4dcf-b5ff-53f8b2b171db]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:32 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:32 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f31b822-2c40-487c-98c0-0e30ced28b28]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b, portal: 172.16.0.220,3260]
Apr 13 19:06:32 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b, portal: 172.16.0.220,3260] successful.
Apr 13 19:06:32 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9f7fa7-634e-444b-a1bd-064929ff6cc5]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[082eb245-8dd4-4b3f-89a6-4c10cbbebfdf]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:32 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:06:32 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:32 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:06:32 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae29d57-a302-43c1-9a53-66397830fef6]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:06:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQVBZERi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26365393338663838', 'path': '/dev/sdc'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365393338663838', 'path': '/dev/sdc'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krjIcgPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:06:33 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:06:33 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:06:33 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c25c417-9621-433f-a7db-19b9c9e4e2a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:06:33 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d826cd-4d3a-433c-a237-174759c83a5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407] added
Apr 13 19:06:33 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[054361a4-2a18-4f41-bf5a-d87faf81175c]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[787af5df-0d78-42ce-9cc1-abe558b16a33]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v krjIcgPe {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v krjIcgPe" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d48667-f9fa-407e-93dd-6e80a3860298]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'krjIcgPe'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4655b9da-2029-49b1-b274-484b7eba816e]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[707d4ced-f7a4-4f0f-b041-dc83fae861c4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:33 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:06:33 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:33 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:06:33 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG nova.compute.manager [req-8866d284-4620-4826-99fd-f31b562df02f req-396029df-7637-4aa8-b7be-4818b4d6d507 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Received event network-changed-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG nova.compute.manager [req-8866d284-4620-4826-99fd-f31b562df02f req-396029df-7637-4aa8-b7be-4818b4d6d507 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Refreshing instance network info cache due to event network-changed-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8866d284-4620-4826-99fd-f31b562df02f req-396029df-7637-4aa8-b7be-4818b4d6d507 service nova] Acquiring lock "refresh_cache-cb3fb753-ff8d-4dac-ab70-f940233bf25d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8866d284-4620-4826-99fd-f31b562df02f req-396029df-7637-4aa8-b7be-4818b4d6d507 service nova] Acquired lock "refresh_cache-cb3fb753-ff8d-4dac-ab70-f940233bf25d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG nova.network.neutron [req-8866d284-4620-4826-99fd-f31b562df02f req-396029df-7637-4aa8-b7be-4818b4d6d507 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Refreshing network info cache for port cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a108c223-3217-4135-9cbd-6076de6897d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407, portal: 172.16.0.220,3260]
Apr 13 19:06:33 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407, portal: 172.16.0.220,3260] successful.
Apr 13 19:06:33 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaef1f4f-5408-430a-a9e6-bff65b7d68e7]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[598cadd0-7e8c-47a9-bcf2-88ee054d785d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:33 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:06:33 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:06:33 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:33 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:06:33 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:06:33 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc8a4b7-fcf8-4ba1-a01c-3f266d8d66c9]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krjIcgPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lazy-loading 'flavor' on Instance uuid cb3fb753-ff8d-4dac-ab70-f940233bf25d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG nova.network.neutron [req-8866d284-4620-4826-99fd-f31b562df02f req-396029df-7637-4aa8-b7be-4818b4d6d507 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Updated VIF entry in instance network info cache for port cec3cf4d-fe86-45a6-97cc-5cbcf2be5818. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG nova.network.neutron [req-8866d284-4620-4826-99fd-f31b562df02f req-396029df-7637-4aa8-b7be-4818b4d6d507 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Updating instance_info_cache with network_info: [{"id": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "address": "fa:16:3e:fd:ca:76", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec3cf4d-fe", "ovs_interfaceid": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8866d284-4620-4826-99fd-f31b562df02f req-396029df-7637-4aa8-b7be-4818b4d6d507 service nova] Releasing lock "refresh_cache-cb3fb753-ff8d-4dac-ab70-f940233bf25d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:34 user nova-compute[71692]: INFO nova.compute.manager [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Attaching volume 65b3e6f5-d237-4a98-907e-49350dc04a3c to /dev/vdb
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.utils [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aecf779-4400-4aa5-85e8-32d4b6b7c374]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b99440-d804-404e-a24e-9e3de9ff58af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8e86b3-7359-442c-90f8-f0808c738892]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fc77ac-d613-4601-96f8-69005b2484f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:06:34 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e953cea6-06b8-4349-83b4-ed98647cfc40]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.utils [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Updating existing volume attachment record: eadfdbd6-de62-47a7-8109-e85877904f7d {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23463616563623431', 'path': '/dev/sdd'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463616563623431', 'path': '/dev/sdd'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNiTgBpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:06:34 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:06:34 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:06:34 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc55a5c3-fd9d-4679-9bb8-f26d2acf0f04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:06:34 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d5be6f-e6f4-460c-9488-37df79741bcb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7] added
Apr 13 19:06:34 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[982c57b0-1c7e-4a7f-afc8-f8b28354b503]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac4521a-a0e6-46a8-a22b-58c89b4ed194]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNiTgBpw {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hNiTgBpw" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c27811-6536-4e9f-a683-8663f3fc2ca6]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hNiTgBpw'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee460cbb-779a-49c5-b7d9-2df27b3d9646]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f9ebdd-3e77-4617-a0cb-5aed63ad3afd]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:34 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:06:34 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:06:34 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:34 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:06:34 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:06:34 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[26094876-045f-473f-80e8-75eb4ffed076]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7, portal: 172.16.0.220,3260]
Apr 13 19:06:34 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7, portal: 172.16.0.220,3260] successful.
Apr 13 19:06:34 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b61c51c-8696-41db-a981-b309a30d72dc]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b51e0e-dfe0-4d23-b58d-3968f6f15758]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:35 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:06:35 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:06:35 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:06:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:06:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:35 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:06:35 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:06:35 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:06:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:06:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:06:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:06:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:06:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:06:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e213b1af-4c4b-4f0d-8a4b-d99b2902f495]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:06:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNiTgBpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:06:35 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:06:35 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:06:35 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:06:35 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23962633266636536', 'path': '/dev/sde'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962633266636536', 'path': '/dev/sde'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "address": "fa:16:3e:5f:cd:f6", "network": {"id": "63a9c9d2-0f2a-4643-b048-dcf2389044cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1932742453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b89f9c-8a", "ovs_interfaceid": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "address": "fa:16:3e:5f:cd:f6", "network": {"id": "63a9c9d2-0f2a-4643-b048-dcf2389044cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1932742453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b89f9c-8a", "ovs_interfaceid": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:cd:f6,bridge_name='br-int',has_traffic_filtering=True,id=28b89f9c-8af3-4c33-89a9-55c61aaafe03,network=Network(63a9c9d2-0f2a-4643-b048-dcf2389044cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b89f9c-8a') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "address": "fa:16:3e:07:f8:b3", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea157b6-07", "ovs_interfaceid": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "address": "fa:16:3e:07:f8:b3", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea157b6-07", "ovs_interfaceid": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:f8:b3,bridge_name='br-int',has_traffic_filtering=True,id=1ea157b6-07a2-4ff3-b11f-b7ea88de6e12,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1ea157b6-07') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4f7e511-017c-4a16-8e0c-21f468f87027", "address": "fa:16:3e:4c:50:43", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7e511-01", "ovs_interfaceid": "d4f7e511-017c-4a16-8e0c-21f468f87027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "d4f7e511-017c-4a16-8e0c-21f468f87027", "address": "fa:16:3e:4c:50:43", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7e511-01", "ovs_interfaceid": "d4f7e511-017c-4a16-8e0c-21f468f87027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:50:43,bridge_name='br-int',has_traffic_filtering=True,id=d4f7e511-017c-4a16-8e0c-21f468f87027,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4f7e511-01') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "address": "fa:16:3e:49:07:8e", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9534ad-df", "ovs_interfaceid": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "address": "fa:16:3e:49:07:8e", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9534ad-df", "ovs_interfaceid": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:07:8e,bridge_name='br-int',has_traffic_filtering=True,id=ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9534ad-df') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "address": "fa:16:3e:44:c2:9d", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0eb0dff-32", "ovs_interfaceid": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "address": "fa:16:3e:44:c2:9d", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0eb0dff-32", "ovs_interfaceid": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:c2:9d,bridge_name='br-int',has_traffic_filtering=True,id=e0eb0dff-32a5-4b83-a302-b1293d0effdc,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0eb0dff-32') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be95859a-0075-4a7d-b4f3-c89c61e54984", "address": "fa:16:3e:1a:a0:c1", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe95859a-00", "ovs_interfaceid": "be95859a-0075-4a7d-b4f3-c89c61e54984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "be95859a-0075-4a7d-b4f3-c89c61e54984", "address": "fa:16:3e:1a:a0:c1", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe95859a-00", "ovs_interfaceid": "be95859a-0075-4a7d-b4f3-c89c61e54984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:a0:c1,bridge_name='br-int',has_traffic_filtering=True,id=be95859a-0075-4a7d-b4f3-c89c61e54984,network=Network(1dfc8e0b-1385-4707-af71-f2b785cb8ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe95859a-00') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d35454b-179a-4fcc-a56d-445475aa2900", "address": "fa:16:3e:54:0a:10", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d35454b-17", "ovs_interfaceid": "5d35454b-179a-4fcc-a56d-445475aa2900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "5d35454b-179a-4fcc-a56d-445475aa2900", "address": "fa:16:3e:54:0a:10", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d35454b-17", "ovs_interfaceid": "5d35454b-179a-4fcc-a56d-445475aa2900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=5d35454b-179a-4fcc-a56d-445475aa2900,network=Network(1dfc8e0b-1385-4707-af71-f2b785cb8ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d35454b-17') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.objects.instance [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e2d4287-0adb-4045-b6e8-25095b5d3bbf {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:06:36 user nova-compute[71692]:   <uuid>4e2d4287-0adb-4045-b6e8-25095b5d3bbf</uuid>
Apr 13 19:06:36 user nova-compute[71692]:   <name>instance-00000012</name>
Apr 13 19:06:36 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:06:36 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:06:36 user nova-compute[71692]:   <metadata>
Apr 13 19:06:36 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:06:36 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:06:36 user nova-compute[71692]:       <nova:name>tempest-device-tagging-server-1531978506</nova:name>
Apr 13 19:06:36 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:06:31</nova:creationTime>
Apr 13 19:06:36 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:06:36 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:06:36 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:06:36 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:06:36 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:06:36 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:06:36 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:06:36 user nova-compute[71692]:       <nova:owner>
Apr 13 19:06:36 user nova-compute[71692]:         <nova:user uuid="8649dbc1659844ef9b98ae022beda26a">tempest-TaggedBootDevicesTest-801682052-project-member</nova:user>
Apr 13 19:06:36 user nova-compute[71692]:         <nova:project uuid="2d8f6086043e47289bafbe341f3379d5">tempest-TaggedBootDevicesTest-801682052</nova:project>
Apr 13 19:06:36 user nova-compute[71692]:       </nova:owner>
Apr 13 19:06:36 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:06:36 user nova-compute[71692]:       <nova:ports>
Apr 13 19:06:36 user nova-compute[71692]:         <nova:port uuid="28b89f9c-8af3-4c33-89a9-55c61aaafe03">
Apr 13 19:06:36 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 19:06:36 user nova-compute[71692]:         </nova:port>
Apr 13 19:06:36 user nova-compute[71692]:         <nova:port uuid="1ea157b6-07a2-4ff3-b11f-b7ea88de6e12">
Apr 13 19:06:36 user nova-compute[71692]:           <nova:ip type="fixed" address="10.1.1.146" ipVersion="4"/>
Apr 13 19:06:36 user nova-compute[71692]:         </nova:port>
Apr 13 19:06:36 user nova-compute[71692]:         <nova:port uuid="d4f7e511-017c-4a16-8e0c-21f468f87027">
Apr 13 19:06:36 user nova-compute[71692]:           <nova:ip type="fixed" address="10.1.1.150" ipVersion="4"/>
Apr 13 19:06:36 user nova-compute[71692]:         </nova:port>
Apr 13 19:06:36 user nova-compute[71692]:         <nova:port uuid="ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22">
Apr 13 19:06:36 user nova-compute[71692]:           <nova:ip type="fixed" address="10.1.1.198" ipVersion="4"/>
Apr 13 19:06:36 user nova-compute[71692]:         </nova:port>
Apr 13 19:06:36 user nova-compute[71692]:         <nova:port uuid="e0eb0dff-32a5-4b83-a302-b1293d0effdc">
Apr 13 19:06:36 user nova-compute[71692]:           <nova:ip type="fixed" address="10.1.1.4" ipVersion="4"/>
Apr 13 19:06:36 user nova-compute[71692]:         </nova:port>
Apr 13 19:06:36 user nova-compute[71692]:         <nova:port uuid="be95859a-0075-4a7d-b4f3-c89c61e54984">
Apr 13 19:06:36 user nova-compute[71692]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 13 19:06:36 user nova-compute[71692]:         </nova:port>
Apr 13 19:06:36 user nova-compute[71692]:         <nova:port uuid="5d35454b-179a-4fcc-a56d-445475aa2900">
Apr 13 19:06:36 user nova-compute[71692]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 13 19:06:36 user nova-compute[71692]:         </nova:port>
Apr 13 19:06:36 user nova-compute[71692]:       </nova:ports>
Apr 13 19:06:36 user nova-compute[71692]:     </nova:instance>
Apr 13 19:06:36 user nova-compute[71692]:   </metadata>
Apr 13 19:06:36 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:06:36 user nova-compute[71692]:     <system>
Apr 13 19:06:36 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:06:36 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:06:36 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:06:36 user nova-compute[71692]:       <entry name="serial">4e2d4287-0adb-4045-b6e8-25095b5d3bbf</entry>
Apr 13 19:06:36 user nova-compute[71692]:       <entry name="uuid">4e2d4287-0adb-4045-b6e8-25095b5d3bbf</entry>
Apr 13 19:06:36 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:06:36 user nova-compute[71692]:     </system>
Apr 13 19:06:36 user nova-compute[71692]:   </sysinfo>
Apr 13 19:06:36 user nova-compute[71692]:   <os>
Apr 13 19:06:36 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:06:36 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:06:36 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:06:36 user nova-compute[71692]:   </os>
Apr 13 19:06:36 user nova-compute[71692]:   <features>
Apr 13 19:06:36 user nova-compute[71692]:     <acpi/>
Apr 13 19:06:36 user nova-compute[71692]:     <apic/>
Apr 13 19:06:36 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:06:36 user nova-compute[71692]:   </features>
Apr 13 19:06:36 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:06:36 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:06:36 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:06:36 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:06:36 user nova-compute[71692]:   </clock>
Apr 13 19:06:36 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:06:36 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:06:36 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:06:36 user nova-compute[71692]:   </cpu>
Apr 13 19:06:36 user nova-compute[71692]:   <devices>
Apr 13 19:06:36 user nova-compute[71692]:     <disk type="file" device="cdrom">
Apr 13 19:06:36 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 19:06:36 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/4e2d4287-0adb-4045-b6e8-25095b5d3bbf/disk.config"/>
Apr 13 19:06:36 user nova-compute[71692]:       <target dev="hda" bus="ide"/>
Apr 13 19:06:36 user nova-compute[71692]:     </disk>
Apr 13 19:06:36 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:06:36 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:06:36 user nova-compute[71692]:       <source dev="/dev/sdc"/>
Apr 13 19:06:36 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:06:36 user nova-compute[71692]:       <serial>5e14c389-bd5a-4d04-aa08-2c6733b87b8b</serial>
Apr 13 19:06:36 user nova-compute[71692]:     </disk>
Apr 13 19:06:36 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:06:36 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:06:36 user nova-compute[71692]:       <source dev="/dev/sdd"/>
Apr 13 19:06:36 user nova-compute[71692]:       <target dev="vdb" bus="virtio"/>
Apr 13 19:06:36 user nova-compute[71692]:       <serial>12c42f5e-32d2-4365-b2e4-096988f7b407</serial>
Apr 13 19:06:36 user nova-compute[71692]:     </disk>
Apr 13 19:06:36 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:06:36 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:06:36 user nova-compute[71692]:       <source dev="/dev/sde"/>
Apr 13 19:06:36 user nova-compute[71692]:       <target dev="vdc" bus="virtio"/>
Apr 13 19:06:36 user nova-compute[71692]:       <serial>304fa834-218d-40d5-a6d1-3b17810e41d7</serial>
Apr 13 19:06:36 user nova-compute[71692]:     </disk>
Apr 13 19:06:36 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:06:36 user nova-compute[71692]:       <mac address="fa:16:3e:5f:cd:f6"/>
Apr 13 19:06:36 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:06:36 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:06:36 user nova-compute[71692]:       <target dev="tap28b89f9c-8a"/>
Apr 13 19:06:36 user nova-compute[71692]:     </interface>
Apr 13 19:06:36 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:06:36 user nova-compute[71692]:       <mac address="fa:16:3e:07:f8:b3"/>
Apr 13 19:06:36 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:06:36 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:06:36 user nova-compute[71692]:       <target dev="tap1ea157b6-07"/>
Apr 13 19:06:36 user nova-compute[71692]:     </interface>
Apr 13 19:06:36 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:06:36 user nova-compute[71692]:       <mac address="fa:16:3e:4c:50:43"/>
Apr 13 19:06:36 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:06:36 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:06:36 user nova-compute[71692]:       <target dev="tapd4f7e511-01"/>
Apr 13 19:06:36 user nova-compute[71692]:     </interface>
Apr 13 19:06:36 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:06:36 user nova-compute[71692]:       <mac address="fa:16:3e:49:07:8e"/>
Apr 13 19:06:36 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:06:36 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:06:36 user nova-compute[71692]:       <target dev="taped9534ad-df"/>
Apr 13 19:06:36 user nova-compute[71692]:     </interface>
Apr 13 19:06:36 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:06:36 user nova-compute[71692]:       <mac address="fa:16:3e:44:c2:9d"/>
Apr 13 19:06:36 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:06:36 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:06:36 user nova-compute[71692]:       <target dev="tape0eb0dff-32"/>
Apr 13 19:06:36 user nova-compute[71692]:     </interface>
Apr 13 19:06:36 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:06:36 user nova-compute[71692]:       <mac address="fa:16:3e:1a:a0:c1"/>
Apr 13 19:06:36 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:06:36 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:06:36 user nova-compute[71692]:       <target dev="tapbe95859a-00"/>
Apr 13 19:06:36 user nova-compute[71692]:     </interface>
Apr 13 19:06:36 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:06:36 user nova-compute[71692]:       <mac address="fa:16:3e:54:0a:10"/>
Apr 13 19:06:36 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:06:36 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:06:36 user nova-compute[71692]:       <target dev="tap5d35454b-17"/>
Apr 13 19:06:36 user nova-compute[71692]:     </interface>
Apr 13 19:06:36 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:06:36 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/4e2d4287-0adb-4045-b6e8-25095b5d3bbf/console.log" append="off"/>
Apr 13 19:06:36 user nova-compute[71692]:     </serial>
Apr 13 19:06:36 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:06:36 user nova-compute[71692]:     <video>
Apr 13 19:06:36 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:06:36 user nova-compute[71692]:     </video>
Apr 13 19:06:36 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:06:36 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:06:36 user nova-compute[71692]:     </rng>
Apr 13 19:06:36 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:06:36 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:06:36 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:06:36 user nova-compute[71692]:     </memballoon>
Apr 13 19:06:36 user nova-compute[71692]:   </devices>
Apr 13 19:06:36 user nova-compute[71692]: </domain>
Apr 13 19:06:36 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "address": "fa:16:3e:5f:cd:f6", "network": {"id": "63a9c9d2-0f2a-4643-b048-dcf2389044cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1932742453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b89f9c-8a", "ovs_interfaceid": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "address": "fa:16:3e:5f:cd:f6", "network": {"id": "63a9c9d2-0f2a-4643-b048-dcf2389044cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1932742453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b89f9c-8a", "ovs_interfaceid": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:cd:f6,bridge_name='br-int',has_traffic_filtering=True,id=28b89f9c-8af3-4c33-89a9-55c61aaafe03,network=Network(63a9c9d2-0f2a-4643-b048-dcf2389044cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b89f9c-8a') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG os_vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:cd:f6,bridge_name='br-int',has_traffic_filtering=True,id=28b89f9c-8af3-4c33-89a9-55c61aaafe03,network=Network(63a9c9d2-0f2a-4643-b048-dcf2389044cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b89f9c-8a') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28b89f9c-8a, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28b89f9c-8a, col_values=(('external_ids', {'iface-id': '28b89f9c-8af3-4c33-89a9-55c61aaafe03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:cd:f6', 'vm-uuid': '4e2d4287-0adb-4045-b6e8-25095b5d3bbf'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: INFO os_vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:cd:f6,bridge_name='br-int',has_traffic_filtering=True,id=28b89f9c-8af3-4c33-89a9-55c61aaafe03,network=Network(63a9c9d2-0f2a-4643-b048-dcf2389044cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b89f9c-8a')
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "address": "fa:16:3e:07:f8:b3", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea157b6-07", "ovs_interfaceid": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "address": "fa:16:3e:07:f8:b3", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea157b6-07", "ovs_interfaceid": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:f8:b3,bridge_name='br-int',has_traffic_filtering=True,id=1ea157b6-07a2-4ff3-b11f-b7ea88de6e12,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1ea157b6-07') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG os_vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:f8:b3,bridge_name='br-int',has_traffic_filtering=True,id=1ea157b6-07a2-4ff3-b11f-b7ea88de6e12,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1ea157b6-07') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ea157b6-07, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ea157b6-07, col_values=(('external_ids', {'iface-id': '1ea157b6-07a2-4ff3-b11f-b7ea88de6e12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:f8:b3', 'vm-uuid': '4e2d4287-0adb-4045-b6e8-25095b5d3bbf'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: INFO os_vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:f8:b3,bridge_name='br-int',has_traffic_filtering=True,id=1ea157b6-07a2-4ff3-b11f-b7ea88de6e12,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1ea157b6-07')
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4f7e511-017c-4a16-8e0c-21f468f87027", "address": "fa:16:3e:4c:50:43", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7e511-01", "ovs_interfaceid": "d4f7e511-017c-4a16-8e0c-21f468f87027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "d4f7e511-017c-4a16-8e0c-21f468f87027", "address": "fa:16:3e:4c:50:43", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7e511-01", "ovs_interfaceid": "d4f7e511-017c-4a16-8e0c-21f468f87027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:50:43,bridge_name='br-int',has_traffic_filtering=True,id=d4f7e511-017c-4a16-8e0c-21f468f87027,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4f7e511-01') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG os_vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:50:43,bridge_name='br-int',has_traffic_filtering=True,id=d4f7e511-017c-4a16-8e0c-21f468f87027,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4f7e511-01') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4f7e511-01, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4f7e511-01, col_values=(('external_ids', {'iface-id': 'd4f7e511-017c-4a16-8e0c-21f468f87027', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:50:43', 'vm-uuid': '4e2d4287-0adb-4045-b6e8-25095b5d3bbf'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: INFO os_vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:50:43,bridge_name='br-int',has_traffic_filtering=True,id=d4f7e511-017c-4a16-8e0c-21f468f87027,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4f7e511-01')
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "address": "fa:16:3e:49:07:8e", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9534ad-df", "ovs_interfaceid": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "address": "fa:16:3e:49:07:8e", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9534ad-df", "ovs_interfaceid": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:07:8e,bridge_name='br-int',has_traffic_filtering=True,id=ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9534ad-df') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG os_vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:07:8e,bridge_name='br-int',has_traffic_filtering=True,id=ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9534ad-df') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped9534ad-df, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped9534ad-df, col_values=(('external_ids', {'iface-id': 'ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:07:8e', 'vm-uuid': '4e2d4287-0adb-4045-b6e8-25095b5d3bbf'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: INFO os_vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:07:8e,bridge_name='br-int',has_traffic_filtering=True,id=ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9534ad-df')
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "address": "fa:16:3e:44:c2:9d", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0eb0dff-32", "ovs_interfaceid": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "address": "fa:16:3e:44:c2:9d", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0eb0dff-32", "ovs_interfaceid": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:c2:9d,bridge_name='br-int',has_traffic_filtering=True,id=e0eb0dff-32a5-4b83-a302-b1293d0effdc,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0eb0dff-32') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG os_vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c2:9d,bridge_name='br-int',has_traffic_filtering=True,id=e0eb0dff-32a5-4b83-a302-b1293d0effdc,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0eb0dff-32') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0eb0dff-32, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0eb0dff-32, col_values=(('external_ids', {'iface-id': 'e0eb0dff-32a5-4b83-a302-b1293d0effdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:c2:9d', 'vm-uuid': '4e2d4287-0adb-4045-b6e8-25095b5d3bbf'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: INFO os_vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c2:9d,bridge_name='br-int',has_traffic_filtering=True,id=e0eb0dff-32a5-4b83-a302-b1293d0effdc,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0eb0dff-32')
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be95859a-0075-4a7d-b4f3-c89c61e54984", "address": "fa:16:3e:1a:a0:c1", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe95859a-00", "ovs_interfaceid": "be95859a-0075-4a7d-b4f3-c89c61e54984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "be95859a-0075-4a7d-b4f3-c89c61e54984", "address": "fa:16:3e:1a:a0:c1", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe95859a-00", "ovs_interfaceid": "be95859a-0075-4a7d-b4f3-c89c61e54984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:a0:c1,bridge_name='br-int',has_traffic_filtering=True,id=be95859a-0075-4a7d-b4f3-c89c61e54984,network=Network(1dfc8e0b-1385-4707-af71-f2b785cb8ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe95859a-00') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG os_vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:a0:c1,bridge_name='br-int',has_traffic_filtering=True,id=be95859a-0075-4a7d-b4f3-c89c61e54984,network=Network(1dfc8e0b-1385-4707-af71-f2b785cb8ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe95859a-00') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe95859a-00, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe95859a-00, col_values=(('external_ids', {'iface-id': 'be95859a-0075-4a7d-b4f3-c89c61e54984', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:a0:c1', 'vm-uuid': '4e2d4287-0adb-4045-b6e8-25095b5d3bbf'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: INFO os_vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:a0:c1,bridge_name='br-int',has_traffic_filtering=True,id=be95859a-0075-4a7d-b4f3-c89c61e54984,network=Network(1dfc8e0b-1385-4707-af71-f2b785cb8ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe95859a-00')
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:06:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d35454b-179a-4fcc-a56d-445475aa2900", "address": "fa:16:3e:54:0a:10", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d35454b-17", "ovs_interfaceid": "5d35454b-179a-4fcc-a56d-445475aa2900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "5d35454b-179a-4fcc-a56d-445475aa2900", "address": "fa:16:3e:54:0a:10", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d35454b-17", "ovs_interfaceid": "5d35454b-179a-4fcc-a56d-445475aa2900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=5d35454b-179a-4fcc-a56d-445475aa2900,network=Network(1dfc8e0b-1385-4707-af71-f2b785cb8ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d35454b-17') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG os_vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=5d35454b-179a-4fcc-a56d-445475aa2900,network=Network(1dfc8e0b-1385-4707-af71-f2b785cb8ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d35454b-17') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d35454b-17, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d35454b-17, col_values=(('external_ids', {'iface-id': '5d35454b-179a-4fcc-a56d-445475aa2900', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:0a:10', 'vm-uuid': '4e2d4287-0adb-4045-b6e8-25095b5d3bbf'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:36 user nova-compute[71692]: INFO os_vif [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=5d35454b-179a-4fcc-a56d-445475aa2900,network=Network(1dfc8e0b-1385-4707-af71-f2b785cb8ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d35454b-17')
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] No BDM found with device name hda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] No VIF found with MAC fa:16:3e:5f:cd:f6, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] No VIF found with MAC fa:16:3e:44:c2:9d, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:06:36 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Using config drive
Apr 13 19:06:36 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Creating config drive at /opt/stack/data/nova/instances/4e2d4287-0adb-4045-b6e8-25095b5d3bbf/disk.config
Apr 13 19:06:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4e2d4287-0adb-4045-b6e8-25095b5d3bbf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnu3vu87g {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4e2d4287-0adb-4045-b6e8-25095b5d3bbf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpnu3vu87g" returned: 0 in 0.054s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:37 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:06:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:06:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Didn't find any instances for network info cache update. {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG nova.compute.manager [req-2fa8b37e-7edf-40ee-ae13-2753c775036b req-99eb0c33-0645-4a31-83cb-e2131b2f8bfb service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-28b89f9c-8af3-4c33-89a9-55c61aaafe03 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2fa8b37e-7edf-40ee-ae13-2753c775036b req-99eb0c33-0645-4a31-83cb-e2131b2f8bfb service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2fa8b37e-7edf-40ee-ae13-2753c775036b req-99eb0c33-0645-4a31-83cb-e2131b2f8bfb service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2fa8b37e-7edf-40ee-ae13-2753c775036b req-99eb0c33-0645-4a31-83cb-e2131b2f8bfb service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG nova.compute.manager [req-2fa8b37e-7edf-40ee-ae13-2753c775036b req-99eb0c33-0645-4a31-83cb-e2131b2f8bfb service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-28b89f9c-8af3-4c33-89a9-55c61aaafe03 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:38 user nova-compute[71692]: WARNING nova.compute.manager [req-2fa8b37e-7edf-40ee-ae13-2753c775036b req-99eb0c33-0645-4a31-83cb-e2131b2f8bfb service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-28b89f9c-8af3-4c33-89a9-55c61aaafe03 for instance with vm_state building and task_state spawning.
Apr 13 19:06:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG nova.compute.manager [req-db1fea7a-3f18-447a-a2c8-cbe93ac42c5f req-91a9e29b-e163-463a-93ea-30f7d8d64f37 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-db1fea7a-3f18-447a-a2c8-cbe93ac42c5f req-91a9e29b-e163-463a-93ea-30f7d8d64f37 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-db1fea7a-3f18-447a-a2c8-cbe93ac42c5f req-91a9e29b-e163-463a-93ea-30f7d8d64f37 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-db1fea7a-3f18-447a-a2c8-cbe93ac42c5f req-91a9e29b-e163-463a-93ea-30f7d8d64f37 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG nova.compute.manager [req-db1fea7a-3f18-447a-a2c8-cbe93ac42c5f req-91a9e29b-e163-463a-93ea-30f7d8d64f37 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:38 user nova-compute[71692]: WARNING nova.compute.manager [req-db1fea7a-3f18-447a-a2c8-cbe93ac42c5f req-91a9e29b-e163-463a-93ea-30f7d8d64f37 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 for instance with vm_state building and task_state spawning.
Apr 13 19:06:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkvVwrMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:06:39 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:06:39 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:06:39 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[002cd9e9-0992-4588-8e3b-a9c702d8f38b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:06:39 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1e9fab-fa58-4e68-93df-f5a1fdd86f25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c] added
Apr 13 19:06:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3e3b7d-fd37-49e1-b71c-8d780f0b472d]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ca5f59-71ac-4b81-8a66-afaf8d43f3a2]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lkvVwrMH {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lkvVwrMH" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b468900-d91d-46a5-ad59-ab5d16af61a5]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lkvVwrMH'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d8948b-70a2-4652-a0bd-59e56028cbe7]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[623ea0f4-2a67-414f-bd1e-dc6f772f5052]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:39 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:06:39 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:06:39 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:06:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:39 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:06:39 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:06:39 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:06:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4218a44-edab-4dbe-ba52-b99b389b8e83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c, portal: 172.16.0.220,3260]
Apr 13 19:06:39 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c, portal: 172.16.0.220,3260] successful.
Apr 13 19:06:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f476a5d-109d-4c3d-b7e2-fb9d691f3b05]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e2fbf0-0c91-4fd2-8de1-8e68eaf49668]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:39 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:06:39 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:06:39 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:06:39 user nova-compute[71692]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c (non-flash)
Apr 13 19:06:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:39 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:06:39 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:06:39 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:06:39 user nova-compute[71692]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c (non-flash)
Apr 13 19:06:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[433e6b59-7b8c-4bfd-8c2a-ede47b58a128]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkvVwrMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-53843340-5f79-4ff4-b132-7c69d9ae385a req-01bbf3d7-359d-4729-b87c-2bee47758c25 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-be95859a-0075-4a7d-b4f3-c89c61e54984 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-53843340-5f79-4ff4-b132-7c69d9ae385a req-01bbf3d7-359d-4729-b87c-2bee47758c25 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-53843340-5f79-4ff4-b132-7c69d9ae385a req-01bbf3d7-359d-4729-b87c-2bee47758c25 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-53843340-5f79-4ff4-b132-7c69d9ae385a req-01bbf3d7-359d-4729-b87c-2bee47758c25 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-53843340-5f79-4ff4-b132-7c69d9ae385a req-01bbf3d7-359d-4729-b87c-2bee47758c25 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-be95859a-0075-4a7d-b4f3-c89c61e54984 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:40 user nova-compute[71692]: WARNING nova.compute.manager [req-53843340-5f79-4ff4-b132-7c69d9ae385a req-01bbf3d7-359d-4729-b87c-2bee47758c25 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-be95859a-0075-4a7d-b4f3-c89c61e54984 for instance with vm_state building and task_state spawning.
Apr 13 19:06:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23038323737313964', 'path': '/dev/sdf'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038323737313964', 'path': '/dev/sdf'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lazy-loading 'flavor' on Instance uuid cb3fb753-ff8d-4dac-ab70-f940233bf25d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:06:40 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:06:40 user nova-compute[71692]:   <source dev="/dev/sdf"/>
Apr 13 19:06:40 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:06:40 user nova-compute[71692]:   <serial>65b3e6f5-d237-4a98-907e-49350dc04a3c</serial>
Apr 13 19:06:40 user nova-compute[71692]: </disk>
Apr 13 19:06:40 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-28b89f9c-8af3-4c33-89a9-55c61aaafe03 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-28b89f9c-8af3-4c33-89a9-55c61aaafe03 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:40 user nova-compute[71692]: WARNING nova.compute.manager [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-28b89f9c-8af3-4c33-89a9-55c61aaafe03 for instance with vm_state building and task_state spawning.
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-5d35454b-179a-4fcc-a56d-445475aa2900 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-5d35454b-179a-4fcc-a56d-445475aa2900 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:40 user nova-compute[71692]: WARNING nova.compute.manager [req-b0268b5f-7e9e-4e5c-bbb8-d12b56717ff8 req-efb6746d-4c10-4fb0-903e-b8d379753fb9 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-5d35454b-179a-4fcc-a56d-445475aa2900 for instance with vm_state building and task_state spawning.
Apr 13 19:06:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:40 user nova-compute[71692]: WARNING nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 for instance with vm_state building and task_state spawning.
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-d4f7e511-017c-4a16-8e0c-21f468f87027 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-d4f7e511-017c-4a16-8e0c-21f468f87027 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:40 user nova-compute[71692]: WARNING nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-d4f7e511-017c-4a16-8e0c-21f468f87027 for instance with vm_state building and task_state spawning.
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-d4f7e511-017c-4a16-8e0c-21f468f87027 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-d4f7e511-017c-4a16-8e0c-21f468f87027 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:40 user nova-compute[71692]: WARNING nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-d4f7e511-017c-4a16-8e0c-21f468f87027 for instance with vm_state building and task_state spawning.
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:40 user nova-compute[71692]: WARNING nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 for instance with vm_state building and task_state spawning.
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:40 user nova-compute[71692]: WARNING nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 for instance with vm_state building and task_state spawning.
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-e0eb0dff-32a5-4b83-a302-b1293d0effdc {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-e0eb0dff-32a5-4b83-a302-b1293d0effdc {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:40 user nova-compute[71692]: WARNING nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-e0eb0dff-32a5-4b83-a302-b1293d0effdc for instance with vm_state building and task_state spawning.
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-e0eb0dff-32a5-4b83-a302-b1293d0effdc {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-e0eb0dff-32a5-4b83-a302-b1293d0effdc {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:40 user nova-compute[71692]: WARNING nova.compute.manager [req-cbbe5fb2-ac96-4199-83c2-e8ef7a7b0f40 req-0ed52529-ea7b-4f28-a16e-c1a5d8e628c2 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-e0eb0dff-32a5-4b83-a302-b1293d0effdc for instance with vm_state building and task_state spawning.
Apr 13 19:06:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] No VIF found with MAC fa:16:3e:fd:ca:76, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ccb64375-0ba1-412c-a24a-03071541f372 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.083s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-b81f4892-5b6d-4dcf-997f-234590565d36 req-d81337a7-d8eb-4aed-b22c-88e371e1b9b8 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-be95859a-0075-4a7d-b4f3-c89c61e54984 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b81f4892-5b6d-4dcf-997f-234590565d36 req-d81337a7-d8eb-4aed-b22c-88e371e1b9b8 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b81f4892-5b6d-4dcf-997f-234590565d36 req-d81337a7-d8eb-4aed-b22c-88e371e1b9b8 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b81f4892-5b6d-4dcf-997f-234590565d36 req-d81337a7-d8eb-4aed-b22c-88e371e1b9b8 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-b81f4892-5b6d-4dcf-997f-234590565d36 req-d81337a7-d8eb-4aed-b22c-88e371e1b9b8 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-be95859a-0075-4a7d-b4f3-c89c61e54984 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:42 user nova-compute[71692]: WARNING nova.compute.manager [req-b81f4892-5b6d-4dcf-997f-234590565d36 req-d81337a7-d8eb-4aed-b22c-88e371e1b9b8 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-be95859a-0075-4a7d-b4f3-c89c61e54984 for instance with vm_state building and task_state spawning.
Apr 13 19:06:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-220c9cf7-1343-413d-b085-7f337b1e49d6 req-54aee47f-7d73-47b6-8056-4eea84f2e916 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-5d35454b-179a-4fcc-a56d-445475aa2900 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-220c9cf7-1343-413d-b085-7f337b1e49d6 req-54aee47f-7d73-47b6-8056-4eea84f2e916 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-220c9cf7-1343-413d-b085-7f337b1e49d6 req-54aee47f-7d73-47b6-8056-4eea84f2e916 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-220c9cf7-1343-413d-b085-7f337b1e49d6 req-54aee47f-7d73-47b6-8056-4eea84f2e916 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-220c9cf7-1343-413d-b085-7f337b1e49d6 req-54aee47f-7d73-47b6-8056-4eea84f2e916 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-5d35454b-179a-4fcc-a56d-445475aa2900 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:06:42 user nova-compute[71692]: WARNING nova.compute.manager [req-220c9cf7-1343-413d-b085-7f337b1e49d6 req-54aee47f-7d73-47b6-8056-4eea84f2e916 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-5d35454b-179a-4fcc-a56d-445475aa2900 for instance with vm_state building and task_state spawning.
Apr 13 19:06:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412802.6987197, 4e2d4287-0adb-4045-b6e8-25095b5d3bbf => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:06:42 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] VM Resumed (Lifecycle Event)
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.compute.manager [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:06:42 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Instance spawned successfully.
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:06:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:06:43 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412802.704973, 4e2d4287-0adb-4045-b6e8-25095b5d3bbf => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:06:43 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] VM Started (Lifecycle Event)
Apr 13 19:06:43 user nova-compute[71692]: INFO nova.compute.manager [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Took 11.42 seconds to spawn the instance on the hypervisor.
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:06:43 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:06:43 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8222MB free_disk=26.266273498535156GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:43 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:06:43 user nova-compute[71692]: INFO nova.compute.manager [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Detaching volume 65b3e6f5-d237-4a98-907e-49350dc04a3c
Apr 13 19:06:43 user nova-compute[71692]: INFO nova.compute.manager [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Took 26.70 seconds to build instance.
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Applying migration context for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 as it has an incoming, in-progress migration 95ab6c80-742d-4d26-a57b-7ba48d11618b. Migration status is finished {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 19:06:43 user nova-compute[71692]: INFO nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating resource usage from migration 95ab6c80-742d-4d26-a57b-7ba48d11618b
Apr 13 19:06:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3b2ef445-cd85-4611-b2d8-7202eb11a2a4 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.794s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 59d7b86a-c723-4255-827e-2f6a641239df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance cb3fb753-ff8d-4dac-ab70-f940233bf25d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Migration 95ab6c80-742d-4d26-a57b-7ba48d11618b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:06:43 user nova-compute[71692]: INFO nova.virt.block_device [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Attempting to driver detach volume 65b3e6f5-d237-4a98-907e-49350dc04a3c from mountpoint /dev/vdb
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Attempting to detach device vdb from instance cb3fb753-ff8d-4dac-ab70-f940233bf25d from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:06:43 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:06:43 user nova-compute[71692]:   <source dev="/dev/sdf"/>
Apr 13 19:06:43 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:06:43 user nova-compute[71692]:   <serial>65b3e6f5-d237-4a98-907e-49350dc04a3c</serial>
Apr 13 19:06:43 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:06:43 user nova-compute[71692]: </disk>
Apr 13 19:06:43 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:06:43 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Successfully detached device vdb from instance cb3fb753-ff8d-4dac-ab70-f940233bf25d from the persistent domain config.
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cb3fb753-ff8d-4dac-ab70-f940233bf25d from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:06:43 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:06:43 user nova-compute[71692]:   <source dev="/dev/sdf"/>
Apr 13 19:06:43 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:06:43 user nova-compute[71692]:   <serial>65b3e6f5-d237-4a98-907e-49350dc04a3c</serial>
Apr 13 19:06:43 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:06:43 user nova-compute[71692]: </disk>
Apr 13 19:06:43 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:06:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681412804.0447342, cb3fb753-ff8d-4dac-ab70-f940233bf25d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cb3fb753-ff8d-4dac-ab70-f940233bf25d {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:06:44 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Successfully detached device vdb from instance cb3fb753-ff8d-4dac-ab70-f940233bf25d from the live domain config.
Apr 13 19:06:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkvVwrMH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:06:44 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1e74e7-d884-4bc4-a56e-a60c352826f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:06:44 user nova-compute[71692]: No targets found.
Apr 13 19:06:44 user nova-compute[71692]: iSNS:
Apr 13 19:06:44 user nova-compute[71692]: No targets found.
Apr 13 19:06:44 user nova-compute[71692]: STATIC:
Apr 13 19:06:44 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b
Apr 13 19:06:44 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:06:44 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:06:44 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c
Apr 13 19:06:44 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:06:44 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:06:44 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414
Apr 13 19:06:44 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:06:44 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:06:44 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7
Apr 13 19:06:44 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:06:44 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:06:44 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407
Apr 13 19:06:44 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:06:44 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:06:44 user nova-compute[71692]: FIRMWARE:
Apr 13 19:06:44 user nova-compute[71692]: No targets found.
Apr 13 19:06:44 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:06:44 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:06:44 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a96b6e-64a7-47a3-a710-6fce98e491ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f32d01d-da98-4fa1-84a0-66087284d1b2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:44 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:06:44 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:06:44 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:06:44 user nova-compute[71692]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c (non-flash)
Apr 13 19:06:44 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:06:44 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:06:44 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:06:44 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:06:44 user nova-compute[71692]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c (non-flash)
Apr 13 19:06:44 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc6a2cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c'): ({'sdf'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Removing single pathed devices sdf {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ac8f3c-5c87-4e82-a382-d3254bd3d4b5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[592375ad-7322-4661-a817-93b7223bf535]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Flushing IO for device /dev/sdf {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fae395-2162-4b64-975e-5f8fc0611eeb]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19aad07-6f92-478c-a109-48e5b2987f13]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] SCSI volumes sdf have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d53bb1-4930-4279-be04-b22f1bdd06e6]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c96fba-a066-47f2-81e4-d971fe906803]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c, portal: 172.16.0.220,3260]
Apr 13 19:06:44 user nova-compute[71692]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c, portal: 172.16.0.220,3260] successful.
Apr 13 19:06:44 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65b3e6f5-d237-4a98-907e-49350dc04a3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c524a09-d100-4f27-8e4d-fdf17c513853]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] <== disconnect_volume: return (341ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:06:44 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:06:45 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lazy-loading 'flavor' on Instance uuid cb3fb753-ff8d-4dac-ab70-f940233bf25d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:06:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0869f891-82e8-4096-b1de-707921148270 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.872s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:06:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:06:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:06:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:06:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:06:57 user nova-compute[71692]: INFO nova.compute.claims [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Claim successful on node user
Apr 13 19:06:57 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG nova.network.neutron [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:06:57 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:06:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:06:57 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Creating image(s)
Apr 13 19:06:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "/opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "/opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG nova.policy [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba70f34af8664dc89fd9851d00d5b96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b52d6508154a918a13b31712b32796', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.149s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.150s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk 1073741824" returned: 0 in 0.051s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:58 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:06:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:06:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:06:58 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Cannot resize image /opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:06:58 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'migration_context' on Instance uuid ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:06:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:06:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Ensure instance console log exists: /opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:06:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:06:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:06:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:06:58 user nova-compute[71692]: DEBUG nova.network.neutron [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Successfully created port: 3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Successfully updated port: 3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "refresh_cache-ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquired lock "refresh_cache-ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-df7de267-a44b-4b8e-ae87-f612c3d95e39 req-adf5d166-b65d-456d-a80b-a734d1d3c526 service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Received event network-changed-3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-df7de267-a44b-4b8e-ae87-f612c3d95e39 req-adf5d166-b65d-456d-a80b-a734d1d3c526 service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Refreshing instance network info cache due to event network-changed-3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-df7de267-a44b-4b8e-ae87-f612c3d95e39 req-adf5d166-b65d-456d-a80b-a734d1d3c526 service nova] Acquiring lock "refresh_cache-ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Updating instance_info_cache with network_info: [{"id": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "address": "fa:16:3e:a2:8d:49", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4cf848-65", "ovs_interfaceid": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Releasing lock "refresh_cache-ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Instance network_info: |[{"id": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "address": "fa:16:3e:a2:8d:49", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4cf848-65", "ovs_interfaceid": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-df7de267-a44b-4b8e-ae87-f612c3d95e39 req-adf5d166-b65d-456d-a80b-a734d1d3c526 service nova] Acquired lock "refresh_cache-ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.network.neutron [req-df7de267-a44b-4b8e-ae87-f612c3d95e39 req-adf5d166-b65d-456d-a80b-a734d1d3c526 service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Refreshing network info cache for port 3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Start _get_guest_xml network_info=[{"id": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "address": "fa:16:3e:a2:8d:49", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4cf848-65", "ovs_interfaceid": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:06:59 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:06:59 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:06:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2001415604',display_name='tempest-AttachVolumeTestJSON-server-2001415604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2001415604',id=19,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnAulYdzoZYhDen0j/UCqj9wvgRtkdJxgu6k5FF+pAw+g1tgcVbg4FL5+E0vKMU+LKWfdF1n4kies8ZDkczIIVHchJ2PqA4lsul63LTo5xP60Cne9rA0PuQcqa4PxWVVw==',key_name='tempest-keypair-293682674',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63b52d6508154a918a13b31712b32796',ramdisk_id='',reservation_id='r-7ije5ap5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-43043273',owner_user_name='tempest-AttachVolumeTestJSON-43043273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:06:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba70f34af8664dc89fd9851d00d5b96d',uuid=ee71fe6c-33cc-45aa-b1b7-2d266fa59b04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "address": "fa:16:3e:a2:8d:49", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4cf848-65", "ovs_interfaceid": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converting VIF {"id": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "address": "fa:16:3e:a2:8d:49", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4cf848-65", "ovs_interfaceid": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:8d:49,bridge_name='br-int',has_traffic_filtering=True,id=3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4cf848-65') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'pci_devices' on Instance uuid ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:06:59 user nova-compute[71692]:   <uuid>ee71fe6c-33cc-45aa-b1b7-2d266fa59b04</uuid>
Apr 13 19:06:59 user nova-compute[71692]:   <name>instance-00000013</name>
Apr 13 19:06:59 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:06:59 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:06:59 user nova-compute[71692]:   <metadata>
Apr 13 19:06:59 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:06:59 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:06:59 user nova-compute[71692]:       <nova:name>tempest-AttachVolumeTestJSON-server-2001415604</nova:name>
Apr 13 19:06:59 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:06:59</nova:creationTime>
Apr 13 19:06:59 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:06:59 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:06:59 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:06:59 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:06:59 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:06:59 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:06:59 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:06:59 user nova-compute[71692]:       <nova:owner>
Apr 13 19:06:59 user nova-compute[71692]:         <nova:user uuid="ba70f34af8664dc89fd9851d00d5b96d">tempest-AttachVolumeTestJSON-43043273-project-member</nova:user>
Apr 13 19:06:59 user nova-compute[71692]:         <nova:project uuid="63b52d6508154a918a13b31712b32796">tempest-AttachVolumeTestJSON-43043273</nova:project>
Apr 13 19:06:59 user nova-compute[71692]:       </nova:owner>
Apr 13 19:06:59 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:06:59 user nova-compute[71692]:       <nova:ports>
Apr 13 19:06:59 user nova-compute[71692]:         <nova:port uuid="3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9">
Apr 13 19:06:59 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 19:06:59 user nova-compute[71692]:         </nova:port>
Apr 13 19:06:59 user nova-compute[71692]:       </nova:ports>
Apr 13 19:06:59 user nova-compute[71692]:     </nova:instance>
Apr 13 19:06:59 user nova-compute[71692]:   </metadata>
Apr 13 19:06:59 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:06:59 user nova-compute[71692]:     <system>
Apr 13 19:06:59 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:06:59 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:06:59 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:06:59 user nova-compute[71692]:       <entry name="serial">ee71fe6c-33cc-45aa-b1b7-2d266fa59b04</entry>
Apr 13 19:06:59 user nova-compute[71692]:       <entry name="uuid">ee71fe6c-33cc-45aa-b1b7-2d266fa59b04</entry>
Apr 13 19:06:59 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:06:59 user nova-compute[71692]:     </system>
Apr 13 19:06:59 user nova-compute[71692]:   </sysinfo>
Apr 13 19:06:59 user nova-compute[71692]:   <os>
Apr 13 19:06:59 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:06:59 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:06:59 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:06:59 user nova-compute[71692]:   </os>
Apr 13 19:06:59 user nova-compute[71692]:   <features>
Apr 13 19:06:59 user nova-compute[71692]:     <acpi/>
Apr 13 19:06:59 user nova-compute[71692]:     <apic/>
Apr 13 19:06:59 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:06:59 user nova-compute[71692]:   </features>
Apr 13 19:06:59 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:06:59 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:06:59 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:06:59 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:06:59 user nova-compute[71692]:   </clock>
Apr 13 19:06:59 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:06:59 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:06:59 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:06:59 user nova-compute[71692]:   </cpu>
Apr 13 19:06:59 user nova-compute[71692]:   <devices>
Apr 13 19:06:59 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:06:59 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:06:59 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk"/>
Apr 13 19:06:59 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:06:59 user nova-compute[71692]:     </disk>
Apr 13 19:06:59 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:06:59 user nova-compute[71692]:       <mac address="fa:16:3e:a2:8d:49"/>
Apr 13 19:06:59 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:06:59 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:06:59 user nova-compute[71692]:       <target dev="tap3e4cf848-65"/>
Apr 13 19:06:59 user nova-compute[71692]:     </interface>
Apr 13 19:06:59 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:06:59 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/console.log" append="off"/>
Apr 13 19:06:59 user nova-compute[71692]:     </serial>
Apr 13 19:06:59 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:06:59 user nova-compute[71692]:     <video>
Apr 13 19:06:59 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:06:59 user nova-compute[71692]:     </video>
Apr 13 19:06:59 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:06:59 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:06:59 user nova-compute[71692]:     </rng>
Apr 13 19:06:59 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:06:59 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:06:59 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:06:59 user nova-compute[71692]:     </memballoon>
Apr 13 19:06:59 user nova-compute[71692]:   </devices>
Apr 13 19:06:59 user nova-compute[71692]: </domain>
Apr 13 19:06:59 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:06:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2001415604',display_name='tempest-AttachVolumeTestJSON-server-2001415604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2001415604',id=19,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnAulYdzoZYhDen0j/UCqj9wvgRtkdJxgu6k5FF+pAw+g1tgcVbg4FL5+E0vKMU+LKWfdF1n4kies8ZDkczIIVHchJ2PqA4lsul63LTo5xP60Cne9rA0PuQcqa4PxWVVw==',key_name='tempest-keypair-293682674',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63b52d6508154a918a13b31712b32796',ramdisk_id='',reservation_id='r-7ije5ap5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-43043273',owner_user_name='tempest-AttachVolumeTestJSON-43043273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:06:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba70f34af8664dc89fd9851d00d5b96d',uuid=ee71fe6c-33cc-45aa-b1b7-2d266fa59b04,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "address": "fa:16:3e:a2:8d:49", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4cf848-65", "ovs_interfaceid": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converting VIF {"id": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "address": "fa:16:3e:a2:8d:49", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4cf848-65", "ovs_interfaceid": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:8d:49,bridge_name='br-int',has_traffic_filtering=True,id=3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4cf848-65') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG os_vif [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:8d:49,bridge_name='br-int',has_traffic_filtering=True,id=3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4cf848-65') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e4cf848-65, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e4cf848-65, col_values=(('external_ids', {'iface-id': '3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:8d:49', 'vm-uuid': 'ee71fe6c-33cc-45aa-b1b7-2d266fa59b04'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:06:59 user nova-compute[71692]: INFO os_vif [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:8d:49,bridge_name='br-int',has_traffic_filtering=True,id=3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4cf848-65')
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:06:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] No VIF found with MAC fa:16:3e:a2:8d:49, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:07:00 user nova-compute[71692]: DEBUG nova.network.neutron [req-df7de267-a44b-4b8e-ae87-f612c3d95e39 req-adf5d166-b65d-456d-a80b-a734d1d3c526 service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Updated VIF entry in instance network info cache for port 3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:07:00 user nova-compute[71692]: DEBUG nova.network.neutron [req-df7de267-a44b-4b8e-ae87-f612c3d95e39 req-adf5d166-b65d-456d-a80b-a734d1d3c526 service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Updating instance_info_cache with network_info: [{"id": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "address": "fa:16:3e:a2:8d:49", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4cf848-65", "ovs_interfaceid": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:07:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-df7de267-a44b-4b8e-ae87-f612c3d95e39 req-adf5d166-b65d-456d-a80b-a734d1d3c526 service nova] Releasing lock "refresh_cache-ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:07:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-64bc2df1-194c-44b8-bcee-70e61e34c3a6 req-796f44c6-4017-477c-9dc0-6278dfe0bda2 service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Received event network-vif-plugged-3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:07:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-64bc2df1-194c-44b8-bcee-70e61e34c3a6 req-796f44c6-4017-477c-9dc0-6278dfe0bda2 service nova] Acquiring lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-64bc2df1-194c-44b8-bcee-70e61e34c3a6 req-796f44c6-4017-477c-9dc0-6278dfe0bda2 service nova] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-64bc2df1-194c-44b8-bcee-70e61e34c3a6 req-796f44c6-4017-477c-9dc0-6278dfe0bda2 service nova] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-64bc2df1-194c-44b8-bcee-70e61e34c3a6 req-796f44c6-4017-477c-9dc0-6278dfe0bda2 service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] No waiting events found dispatching network-vif-plugged-3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:07:01 user nova-compute[71692]: WARNING nova.compute.manager [req-64bc2df1-194c-44b8-bcee-70e61e34c3a6 req-796f44c6-4017-477c-9dc0-6278dfe0bda2 service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Received unexpected event network-vif-plugged-3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 for instance with vm_state building and task_state spawning.
Apr 13 19:07:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412823.394918, ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:07:03 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] VM Resumed (Lifecycle Event)
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:07:03 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Instance spawned successfully.
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:07:03 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412823.3989666, ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:07:03 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] VM Started (Lifecycle Event)
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:07:03 user nova-compute[71692]: INFO nova.compute.manager [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Took 5.68 seconds to spawn the instance on the hypervisor.
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:07:03 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.compute.manager [req-a9878f9f-5f4f-491f-917e-0c57810d96ce req-71e82532-ef1b-4a37-a552-6b920a3f0f5c service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Received event network-vif-plugged-3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:07:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a9878f9f-5f4f-491f-917e-0c57810d96ce req-71e82532-ef1b-4a37-a552-6b920a3f0f5c service nova] Acquiring lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a9878f9f-5f4f-491f-917e-0c57810d96ce req-71e82532-ef1b-4a37-a552-6b920a3f0f5c service nova] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a9878f9f-5f4f-491f-917e-0c57810d96ce req-71e82532-ef1b-4a37-a552-6b920a3f0f5c service nova] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:03 user nova-compute[71692]: DEBUG nova.compute.manager [req-a9878f9f-5f4f-491f-917e-0c57810d96ce req-71e82532-ef1b-4a37-a552-6b920a3f0f5c service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] No waiting events found dispatching network-vif-plugged-3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:07:03 user nova-compute[71692]: WARNING nova.compute.manager [req-a9878f9f-5f4f-491f-917e-0c57810d96ce req-71e82532-ef1b-4a37-a552-6b920a3f0f5c service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Received unexpected event network-vif-plugged-3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 for instance with vm_state active and task_state None.
Apr 13 19:07:03 user nova-compute[71692]: INFO nova.compute.manager [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Took 6.40 seconds to build instance.
Apr 13 19:07:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e7d628f-7b35-40a6-a360-64421d66cdf1 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.508s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:22 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:07:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:22 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:07:22 user nova-compute[71692]: INFO nova.compute.claims [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Claim successful on node user
Apr 13 19:07:23 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:07:23 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:07:23 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG nova.policy [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e44f04fabef14935a4617dd452d3999b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8fe614f0541009788ffe685720634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:07:23 user nova-compute[71692]: INFO nova.virt.block_device [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Booting with volume c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 at /dev/vda
Apr 13 19:07:23 user nova-compute[71692]: DEBUG os_brick.utils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1ab799-9cfd-4a72-b059-194f8d3cb620]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdab74a-1cf7-48e8-81be-2c39b53e663d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72b014a-6578-4905-9926-96b50846008e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[298770bd-9fd4-4681-8057-d24444063362]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:07:23 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:07:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3515f47f-7273-4cf0-98cf-05ea7ceca9f0]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG os_brick.utils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:07:23 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updating existing volume attachment record: 6e29ff73-58f8-41da-af4b-8a93b48e4719 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:07:24 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Successfully created port: 8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:07:24 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Successfully updated port: 8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:07:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:07:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquired lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:07:24 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:07:24 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:07:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-eaf81e88-c86a-445f-b14e-95427ad9f835 req-d8332bbd-abc2-4e74-818c-5fe5dce3a3f9 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received event network-changed-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:07:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-eaf81e88-c86a-445f-b14e-95427ad9f835 req-d8332bbd-abc2-4e74-818c-5fe5dce3a3f9 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Refreshing instance network info cache due to event network-changed-8640b481-7480-494b-a88b-e21419d695cf. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:07:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-eaf81e88-c86a-445f-b14e-95427ad9f835 req-d8332bbd-abc2-4e74-818c-5fe5dce3a3f9 service nova] Acquiring lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:07:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:25 user nova-compute[71692]: DEBUG nova.network.neutron [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updating instance_info_cache with network_info: [{"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:07:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Releasing lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:07:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Instance network_info: |[{"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:07:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-eaf81e88-c86a-445f-b14e-95427ad9f835 req-d8332bbd-abc2-4e74-818c-5fe5dce3a3f9 service nova] Acquired lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:07:25 user nova-compute[71692]: DEBUG nova.network.neutron [req-eaf81e88-c86a-445f-b14e-95427ad9f835 req-d8332bbd-abc2-4e74-818c-5fe5dce3a3f9 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Refreshing network info cache for port 8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:07:25 user nova-compute[71692]: DEBUG nova.network.neutron [req-eaf81e88-c86a-445f-b14e-95427ad9f835 req-d8332bbd-abc2-4e74-818c-5fe5dce3a3f9 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updated VIF entry in instance network info cache for port 8640b481-7480-494b-a88b-e21419d695cf. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:07:25 user nova-compute[71692]: DEBUG nova.network.neutron [req-eaf81e88-c86a-445f-b14e-95427ad9f835 req-d8332bbd-abc2-4e74-818c-5fe5dce3a3f9 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updating instance_info_cache with network_info: [{"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:07:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-eaf81e88-c86a-445f-b14e-95427ad9f835 req-d8332bbd-abc2-4e74-818c-5fe5dce3a3f9 service nova] Releasing lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:07:26 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Port 2b297ca1-e672-438a-917a-df2319262bc0 binding to destination host user is already ACTIVE {{(pid=71692) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 19:07:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:07:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquired lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:07:26 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:07:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:26 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating instance_info_cache with network_info: [{"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:07:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Releasing lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:07:26 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Creating tmpfile /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/tmppb0xbrjv to verify with other compute node that the instance is on the same shared storage. {{(pid=71692) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 13 19:07:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG nova.compute.manager [req-4c7a3aeb-1067-4135-ad63-017a60cf7dd2 req-9b0ea62b-3100-4fcd-bb42-78630762665a service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-unplugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4c7a3aeb-1067-4135-ad63-017a60cf7dd2 req-9b0ea62b-3100-4fcd-bb42-78630762665a service nova] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4c7a3aeb-1067-4135-ad63-017a60cf7dd2 req-9b0ea62b-3100-4fcd-bb42-78630762665a service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4c7a3aeb-1067-4135-ad63-017a60cf7dd2 req-9b0ea62b-3100-4fcd-bb42-78630762665a service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG nova.compute.manager [req-4c7a3aeb-1067-4135-ad63-017a60cf7dd2 req-9b0ea62b-3100-4fcd-bb42-78630762665a service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] No waiting events found dispatching network-vif-unplugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:07:27 user nova-compute[71692]: WARNING nova.compute.manager [req-4c7a3aeb-1067-4135-ad63-017a60cf7dd2 req-9b0ea62b-3100-4fcd-bb42-78630762665a service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received unexpected event network-vif-unplugged-2b297ca1-e672-438a-917a-df2319262bc0 for instance with vm_state resized and task_state resize_reverting.
Apr 13 19:07:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:27 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Instance destroyed successfully.
Apr 13 19:07:27 user nova-compute[71692]: DEBUG nova.objects.instance [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'resources' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T18:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-657008190',display_name='tempest-ServerActionsTestJSON-server-1417744922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-657008190',id=5,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-zw23yzik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:05:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_vif [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b297ca1-e6, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:07:27 user nova-compute[71692]: INFO os_vif [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6')
Apr 13 19:07:27 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyHemtYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:07:27 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[96346dd9-0745-4921-82fc-8a08c998460d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:07:27 user nova-compute[71692]: No targets found.
Apr 13 19:07:27 user nova-compute[71692]: iSNS:
Apr 13 19:07:27 user nova-compute[71692]: No targets found.
Apr 13 19:07:27 user nova-compute[71692]: STATIC:
Apr 13 19:07:27 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b
Apr 13 19:07:27 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:07:27 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:07:27 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414
Apr 13 19:07:27 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:07:27 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:07:27 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7
Apr 13 19:07:27 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:07:27 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:07:27 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407
Apr 13 19:07:27 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:07:27 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:07:27 user nova-compute[71692]: FIRMWARE:
Apr 13 19:07:27 user nova-compute[71692]: No targets found.
Apr 13 19:07:27 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:07:27 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:07:27 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a292d0c-c4d2-426c-ab83-d3dac8dec397]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8d120a-8faf-4c23-963c-761232b78c5b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:07:27 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:07:27 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:07:27 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:07:27 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:07:27 user nova-compute[71692]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:07:27 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:07:27 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:07:27 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc4f43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414'): ({'sdb'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Removing single pathed devices sdb {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4f9d56-ede5-487f-aeb8-8500c793c772]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e81abe-bc53-42bf-b885-eaae59ec3d2c]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flushing IO for device /dev/sdb {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39c46c9-df72-45fa-a825-dcc8eca41db1]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9871f3-1b17-4478-a86f-4d048c83789e]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5063240e-95bb-421b-a5b0-8bf67471caa4]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[da560eeb-4e83-4503-9595-2fbd04a66988]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260]
Apr 13 19:07:27 user nova-compute[71692]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260] successful.
Apr 13 19:07:27 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8adedd-9efa-43f6-961c-b0311a4eb56f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== disconnect_volume: return (313ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:07:27 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:07:28 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Creating image(s)
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Did not create local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Ensure instance console log exists: /opt/stack/data/nova/instances/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Start _get_guest_xml network_info=[{"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '6e29ff73-58f8-41da-af4b-8a93b48e4719', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NeMxmspT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c60e6c0-533c-4fd3-938f-b9ecc9fb0333', 'attached_at': '', 'detached_at': '', 'volume_id': 'c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96', 'serial': 'c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:07:28 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:07:28 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NeMxmspT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:07:28 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:07:28 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:07:28 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26aa2b8-6849-4f64-9a27-7482f9fe916a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:07:28 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadfb2ff-9a8e-4112-9a3e-02126cb12de2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96] added
Apr 13 19:07:28 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f2dee3-6c65-4f1f-bccf-e1127ab96597]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5184848-2b27-46be-978c-3ae3ac20c93e]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NeMxmspT {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NeMxmspT" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca014f3a-4bc7-4878-b1b4-ff0e3ab7f258]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NeMxmspT'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc0adf5-6899-4de5-a40a-8b5ba2889ccf]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[610c3fd1-54db-4fd2-85a2-657552370e6a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:07:28 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:07:28 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:07:28 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:07:28 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:07:28 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:07:28 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90edd0a-bae7-4672-b1f9-c4f9108adaef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96, portal: 172.16.0.220,3260]
Apr 13 19:07:28 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96, portal: 172.16.0.220,3260] successful.
Apr 13 19:07:28 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3982cdf8-604c-4c64-bd07-fa7066bb8db5]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[af951539-2f83-44d8-858b-f3d76497e1c3]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:07:28 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:07:28 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:07:28 user nova-compute[71692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:07:28 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:07:28 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:07:28 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:07:28 user nova-compute[71692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:07:28 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[481a592e-cff3-485d-b1f6-7ae31f7487e5]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NeMxmspT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:28 user nova-compute[71692]: DEBUG nova.objects.instance [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'migration_context' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.compute.manager [req-799de174-95dd-44c6-8548-2c8578212a4d req-04afb23a-178b-4bb7-bb85-8bb0f6c2cf54 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-799de174-95dd-44c6-8548-2c8578212a4d req-04afb23a-178b-4bb7-bb85-8bb0f6c2cf54 service nova] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-799de174-95dd-44c6-8548-2c8578212a4d req-04afb23a-178b-4bb7-bb85-8bb0f6c2cf54 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-799de174-95dd-44c6-8548-2c8578212a4d req-04afb23a-178b-4bb7-bb85-8bb0f6c2cf54 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.compute.manager [req-799de174-95dd-44c6-8548-2c8578212a4d req-04afb23a-178b-4bb7-bb85-8bb0f6c2cf54 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] No waiting events found dispatching network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:07:29 user nova-compute[71692]: WARNING nova.compute.manager [req-799de174-95dd-44c6-8548-2c8578212a4d req-04afb23a-178b-4bb7-bb85-8bb0f6c2cf54 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received unexpected event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 for instance with vm_state resized and task_state resize_reverting.
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.341s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:29 user nova-compute[71692]: INFO nova.compute.manager [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Swapping old allocation on dict_keys(['6ec8625c-38f9-4b14-a833-1c01964497f1']) held by migration 95ab6c80-742d-4d26-a57b-7ba48d11618b for instance
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Overwriting current allocation {'allocations': {'6ec8625c-38f9-4b14-a833-1c01964497f1': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 25}}, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'user_id': 'df209814208d415e9d414d39205aaad6', 'consumer_generation': 1} on consumer b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquired lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23633643935386534', 'path': '/dev/sdb'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633643935386534', 'path': '/dev/sdb'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-83408209',display_name='tempest-TestShelveInstance-server-83408209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-83408209',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIq1t/DMvVpTcEEakPI/0JWmf4BthPiZo8lPCqhHBmih4IYVT4syad6jzJ8PVHxlvM4PPItdyY2igXoht4WeZ8Uv1bT9f9eJhSMIlwuyiyywQzUvP/REC4xOo31hpBbNg==',key_name='tempest-TestShelveInstance-24428880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20b8fe614f0541009788ffe685720634',ramdisk_id='',reservation_id='r-p03apkpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1512441304',owner_user_name='tempest-TestShelveInstance-1512441304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:07:23Z,user_data=None,user_id='e44f04fabef14935a4617dd452d3999b',uuid=8c60e6c0-533c-4fd3-938f-b9ecc9fb0333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Converting VIF {"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e5:46,bridge_name='br-int',has_traffic_filtering=True,id=8640b481-7480-494b-a88b-e21419d695cf,network=Network(caba0c3f-498e-458e-86ba-f7a0a147a7d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8640b481-74') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:07:29 user nova-compute[71692]:   <uuid>8c60e6c0-533c-4fd3-938f-b9ecc9fb0333</uuid>
Apr 13 19:07:29 user nova-compute[71692]:   <name>instance-00000014</name>
Apr 13 19:07:29 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:07:29 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:07:29 user nova-compute[71692]:   <metadata>
Apr 13 19:07:29 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:07:29 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:07:29 user nova-compute[71692]:       <nova:name>tempest-TestShelveInstance-server-83408209</nova:name>
Apr 13 19:07:29 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:07:28</nova:creationTime>
Apr 13 19:07:29 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:07:29 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:07:29 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:07:29 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:07:29 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:07:29 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:07:29 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:07:29 user nova-compute[71692]:       <nova:owner>
Apr 13 19:07:29 user nova-compute[71692]:         <nova:user uuid="e44f04fabef14935a4617dd452d3999b">tempest-TestShelveInstance-1512441304-project-member</nova:user>
Apr 13 19:07:29 user nova-compute[71692]:         <nova:project uuid="20b8fe614f0541009788ffe685720634">tempest-TestShelveInstance-1512441304</nova:project>
Apr 13 19:07:29 user nova-compute[71692]:       </nova:owner>
Apr 13 19:07:29 user nova-compute[71692]:       <nova:ports>
Apr 13 19:07:29 user nova-compute[71692]:         <nova:port uuid="8640b481-7480-494b-a88b-e21419d695cf">
Apr 13 19:07:29 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 19:07:29 user nova-compute[71692]:         </nova:port>
Apr 13 19:07:29 user nova-compute[71692]:       </nova:ports>
Apr 13 19:07:29 user nova-compute[71692]:     </nova:instance>
Apr 13 19:07:29 user nova-compute[71692]:   </metadata>
Apr 13 19:07:29 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:07:29 user nova-compute[71692]:     <system>
Apr 13 19:07:29 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:07:29 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:07:29 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:07:29 user nova-compute[71692]:       <entry name="serial">8c60e6c0-533c-4fd3-938f-b9ecc9fb0333</entry>
Apr 13 19:07:29 user nova-compute[71692]:       <entry name="uuid">8c60e6c0-533c-4fd3-938f-b9ecc9fb0333</entry>
Apr 13 19:07:29 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:07:29 user nova-compute[71692]:     </system>
Apr 13 19:07:29 user nova-compute[71692]:   </sysinfo>
Apr 13 19:07:29 user nova-compute[71692]:   <os>
Apr 13 19:07:29 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:07:29 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:07:29 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:07:29 user nova-compute[71692]:   </os>
Apr 13 19:07:29 user nova-compute[71692]:   <features>
Apr 13 19:07:29 user nova-compute[71692]:     <acpi/>
Apr 13 19:07:29 user nova-compute[71692]:     <apic/>
Apr 13 19:07:29 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:07:29 user nova-compute[71692]:   </features>
Apr 13 19:07:29 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:07:29 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:07:29 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:07:29 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:07:29 user nova-compute[71692]:   </clock>
Apr 13 19:07:29 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:07:29 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:07:29 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:07:29 user nova-compute[71692]:   </cpu>
Apr 13 19:07:29 user nova-compute[71692]:   <devices>
Apr 13 19:07:29 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:07:29 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:07:29 user nova-compute[71692]:       <source dev="/dev/sdb"/>
Apr 13 19:07:29 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:07:29 user nova-compute[71692]:       <serial>c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96</serial>
Apr 13 19:07:29 user nova-compute[71692]:     </disk>
Apr 13 19:07:29 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:07:29 user nova-compute[71692]:       <mac address="fa:16:3e:cb:e5:46"/>
Apr 13 19:07:29 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:07:29 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:07:29 user nova-compute[71692]:       <target dev="tap8640b481-74"/>
Apr 13 19:07:29 user nova-compute[71692]:     </interface>
Apr 13 19:07:29 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:07:29 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333/console.log" append="off"/>
Apr 13 19:07:29 user nova-compute[71692]:     </serial>
Apr 13 19:07:29 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:07:29 user nova-compute[71692]:     <video>
Apr 13 19:07:29 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:07:29 user nova-compute[71692]:     </video>
Apr 13 19:07:29 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:07:29 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:07:29 user nova-compute[71692]:     </rng>
Apr 13 19:07:29 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:07:29 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:07:29 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:07:29 user nova-compute[71692]:     </memballoon>
Apr 13 19:07:29 user nova-compute[71692]:   </devices>
Apr 13 19:07:29 user nova-compute[71692]: </domain>
Apr 13 19:07:29 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-83408209',display_name='tempest-TestShelveInstance-server-83408209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-83408209',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIq1t/DMvVpTcEEakPI/0JWmf4BthPiZo8lPCqhHBmih4IYVT4syad6jzJ8PVHxlvM4PPItdyY2igXoht4WeZ8Uv1bT9f9eJhSMIlwuyiyywQzUvP/REC4xOo31hpBbNg==',key_name='tempest-TestShelveInstance-24428880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20b8fe614f0541009788ffe685720634',ramdisk_id='',reservation_id='r-p03apkpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1512441304',owner_user_name='tempest-TestShelveInstance-1512441304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:07:23Z,user_data=None,user_id='e44f04fabef14935a4617dd452d3999b',uuid=8c60e6c0-533c-4fd3-938f-b9ecc9fb0333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Converting VIF {"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e5:46,bridge_name='br-int',has_traffic_filtering=True,id=8640b481-7480-494b-a88b-e21419d695cf,network=Network(caba0c3f-498e-458e-86ba-f7a0a147a7d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8640b481-74') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG os_vif [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e5:46,bridge_name='br-int',has_traffic_filtering=True,id=8640b481-7480-494b-a88b-e21419d695cf,network=Network(caba0c3f-498e-458e-86ba-f7a0a147a7d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8640b481-74') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8640b481-74, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8640b481-74, col_values=(('external_ids', {'iface-id': '8640b481-7480-494b-a88b-e21419d695cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:e5:46', 'vm-uuid': '8c60e6c0-533c-4fd3-938f-b9ecc9fb0333'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:29 user nova-compute[71692]: INFO os_vif [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e5:46,bridge_name='br-int',has_traffic_filtering=True,id=8640b481-7480-494b-a88b-e21419d695cf,network=Network(caba0c3f-498e-458e-86ba-f7a0a147a7d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8640b481-74')
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] No VIF found with MAC fa:16:3e:cb:e5:46, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:07:29 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating instance_info_cache with network_info: [{"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Releasing lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG os_brick.utils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[02410b42-91dd-4a7d-a279-985dc7441304]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f55658d-a105-4e2b-8837-59f2ded1f79d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f4a647-7093-4326-9e94-02d097f5be10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[78530786-8274-49fd-a76c-8c6f542b69c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:07:30 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:07:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[732023b3-a0ae-4f1b-8310-62962b1ff8d5]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:07:30 user nova-compute[71692]: DEBUG os_brick.utils [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:07:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-dce1d64a-faa6-4901-9992-553693176cef req-0ae8633c-7961-400c-b587-3dd0f607e83a service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received event network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:07:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dce1d64a-faa6-4901-9992-553693176cef req-0ae8633c-7961-400c-b587-3dd0f607e83a service nova] Acquiring lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dce1d64a-faa6-4901-9992-553693176cef req-0ae8633c-7961-400c-b587-3dd0f607e83a service nova] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dce1d64a-faa6-4901-9992-553693176cef req-0ae8633c-7961-400c-b587-3dd0f607e83a service nova] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-dce1d64a-faa6-4901-9992-553693176cef req-0ae8633c-7961-400c-b587-3dd0f607e83a service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] No waiting events found dispatching network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:07:31 user nova-compute[71692]: WARNING nova.compute.manager [req-dce1d64a-faa6-4901-9992-553693176cef req-0ae8633c-7961-400c-b587-3dd0f607e83a service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received unexpected event network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf for instance with vm_state building and task_state spawning.
Apr 13 19:07:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:32 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:07:33 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412853.4951336, 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:07:33 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] VM Resumed (Lifecycle Event)
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:07:33 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Instance spawned successfully.
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:07:33 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412853.4955597, 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:07:33 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] VM Started (Lifecycle Event)
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.compute.manager [req-fda62af7-466e-4d03-83f7-78898fc806e3 req-80e95c26-ece0-423b-b771-d83a936c7be8 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received event network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:07:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-fda62af7-466e-4d03-83f7-78898fc806e3 req-80e95c26-ece0-423b-b771-d83a936c7be8 service nova] Acquiring lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-fda62af7-466e-4d03-83f7-78898fc806e3 req-80e95c26-ece0-423b-b771-d83a936c7be8 service nova] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-fda62af7-466e-4d03-83f7-78898fc806e3 req-80e95c26-ece0-423b-b771-d83a936c7be8 service nova] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.compute.manager [req-fda62af7-466e-4d03-83f7-78898fc806e3 req-80e95c26-ece0-423b-b771-d83a936c7be8 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] No waiting events found dispatching network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:07:33 user nova-compute[71692]: WARNING nova.compute.manager [req-fda62af7-466e-4d03-83f7-78898fc806e3 req-80e95c26-ece0-423b-b771-d83a936c7be8 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received unexpected event network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf for instance with vm_state building and task_state spawning.
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:07:33 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:07:33 user nova-compute[71692]: INFO nova.compute.manager [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Took 5.41 seconds to spawn the instance on the hypervisor.
Apr 13 19:07:33 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:07:33 user nova-compute[71692]: INFO nova.compute.manager [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Took 10.77 seconds to build instance.
Apr 13 19:07:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ab4fdb73-5034-4884-85ea-1c2464b7f699 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.856s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:34 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:07:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Starting finish_revert_migration {{(pid=71692) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Start _get_guest_xml network_info=[{"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': 'd892ed1d-22c7-4488-ac26-efbfd51f60c2', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyHemtYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8', 'attached_at': '2023-04-13T19:07:35.000000', 'detached_at': '', 'volume_id': '50a307e4-f870-4d27-ba29-f61e22e6a414', 'serial': '50a307e4-f870-4d27-ba29-f61e22e6a414'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:07:35 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:07:35 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:07:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG nova.objects.instance [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'vcpu_model' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyHemtYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:07:35 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:07:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:07:35 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:07:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:07:35 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4818583-de51-4743-a492-01bda03d7193]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:07:35 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e964fe-7884-4866-985d-99530dd90bad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414] added
Apr 13 19:07:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e047fa6-e989-418f-b04e-514fff36b9d7]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf9baa8-21aa-4118-96dc-b7948f7ddac1]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dyHemtYs {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dyHemtYs" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[554f87fd-de8a-4f41-89b2-a482c8e64446]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dyHemtYs'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e236b89b-85d8-48ce-a9cc-4f6cb2b808f4]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3f1170-8903-4796-a663-bad4786647d0]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:07:35 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:07:35 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:07:35 user nova-compute[71692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:07:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:07:35 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:07:35 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:07:35 user nova-compute[71692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:07:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:07:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eca4f2-1c17-4ff4-b790-a2224c15706d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260]
Apr 13 19:07:36 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260] successful.
Apr 13 19:07:36 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5757dbab-070e-4135-bff8-088a80c0679d]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c595128c-8829-4b02-b132-3a5444982c98]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:07:36 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:07:36 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:07:36 user nova-compute[71692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:07:36 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:07:36 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:07:36 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:07:36 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:07:36 user nova-compute[71692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:07:36 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:07:36 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce761bbe-5d5b-4812-bcdd-8e1f362be73c]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyHemtYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:36 user nova-compute[71692]: DEBUG nova.compute.manager [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:07:36 user nova-compute[71692]: INFO nova.compute.manager [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] instance snapshotting
Apr 13 19:07:36 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Beginning live snapshot process
Apr 13 19:07:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json -f qcow2 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23763326537656531', 'path': '/dev/sdf'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763326537656531', 'path': '/dev/sdf'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T18:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-657008190',display_name='tempest-ServerActionsTestJSON-server-1417744922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-657008190',id=5,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-zw23yzik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:07:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:07:37 user nova-compute[71692]:   <uuid>b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8</uuid>
Apr 13 19:07:37 user nova-compute[71692]:   <name>instance-00000005</name>
Apr 13 19:07:37 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:07:37 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:07:37 user nova-compute[71692]:   <metadata>
Apr 13 19:07:37 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:07:37 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:07:37 user nova-compute[71692]:       <nova:name>tempest-ServerActionsTestJSON-server-1417744922</nova:name>
Apr 13 19:07:37 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:07:35</nova:creationTime>
Apr 13 19:07:37 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:07:37 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:07:37 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:07:37 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:07:37 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:07:37 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:07:37 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:07:37 user nova-compute[71692]:       <nova:owner>
Apr 13 19:07:37 user nova-compute[71692]:         <nova:user uuid="df209814208d415e9d414d39205aaad6">tempest-ServerActionsTestJSON-1901931474-project-member</nova:user>
Apr 13 19:07:37 user nova-compute[71692]:         <nova:project uuid="c162f91cba4b4ecf9de48fbf839da261">tempest-ServerActionsTestJSON-1901931474</nova:project>
Apr 13 19:07:37 user nova-compute[71692]:       </nova:owner>
Apr 13 19:07:37 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:07:37 user nova-compute[71692]:       <nova:ports>
Apr 13 19:07:37 user nova-compute[71692]:         <nova:port uuid="2b297ca1-e672-438a-917a-df2319262bc0">
Apr 13 19:07:37 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 19:07:37 user nova-compute[71692]:         </nova:port>
Apr 13 19:07:37 user nova-compute[71692]:       </nova:ports>
Apr 13 19:07:37 user nova-compute[71692]:     </nova:instance>
Apr 13 19:07:37 user nova-compute[71692]:   </metadata>
Apr 13 19:07:37 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:07:37 user nova-compute[71692]:     <system>
Apr 13 19:07:37 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:07:37 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:07:37 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:07:37 user nova-compute[71692]:       <entry name="serial">b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8</entry>
Apr 13 19:07:37 user nova-compute[71692]:       <entry name="uuid">b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8</entry>
Apr 13 19:07:37 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:07:37 user nova-compute[71692]:     </system>
Apr 13 19:07:37 user nova-compute[71692]:   </sysinfo>
Apr 13 19:07:37 user nova-compute[71692]:   <os>
Apr 13 19:07:37 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:07:37 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:07:37 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:07:37 user nova-compute[71692]:   </os>
Apr 13 19:07:37 user nova-compute[71692]:   <features>
Apr 13 19:07:37 user nova-compute[71692]:     <acpi/>
Apr 13 19:07:37 user nova-compute[71692]:     <apic/>
Apr 13 19:07:37 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:07:37 user nova-compute[71692]:   </features>
Apr 13 19:07:37 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:07:37 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:07:37 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:07:37 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:07:37 user nova-compute[71692]:   </clock>
Apr 13 19:07:37 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:07:37 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:07:37 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:07:37 user nova-compute[71692]:   </cpu>
Apr 13 19:07:37 user nova-compute[71692]:   <devices>
Apr 13 19:07:37 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:07:37 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:07:37 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk"/>
Apr 13 19:07:37 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:07:37 user nova-compute[71692]:     </disk>
Apr 13 19:07:37 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:07:37 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:07:37 user nova-compute[71692]:       <source dev="/dev/sdf"/>
Apr 13 19:07:37 user nova-compute[71692]:       <target dev="vdb" bus="virtio"/>
Apr 13 19:07:37 user nova-compute[71692]:       <serial>50a307e4-f870-4d27-ba29-f61e22e6a414</serial>
Apr 13 19:07:37 user nova-compute[71692]:     </disk>
Apr 13 19:07:37 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:07:37 user nova-compute[71692]:       <mac address="fa:16:3e:bc:71:09"/>
Apr 13 19:07:37 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:07:37 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:07:37 user nova-compute[71692]:       <target dev="tap2b297ca1-e6"/>
Apr 13 19:07:37 user nova-compute[71692]:     </interface>
Apr 13 19:07:37 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:07:37 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/console.log" append="off"/>
Apr 13 19:07:37 user nova-compute[71692]:     </serial>
Apr 13 19:07:37 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:07:37 user nova-compute[71692]:     <video>
Apr 13 19:07:37 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:07:37 user nova-compute[71692]:     </video>
Apr 13 19:07:37 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:07:37 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:07:37 user nova-compute[71692]:     </rng>
Apr 13 19:07:37 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:07:37 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:07:37 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:07:37 user nova-compute[71692]:     </memballoon>
Apr 13 19:07:37 user nova-compute[71692]:   </devices>
Apr 13 19:07:37 user nova-compute[71692]: </domain>
Apr 13 19:07:37 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T18:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-657008190',display_name='tempest-ServerActionsTestJSON-server-1417744922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-657008190',id=5,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-zw23yzik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:07:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG os_vif [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json -f qcow2 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b297ca1-e6, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b297ca1-e6, col_values=(('external_ids', {'iface-id': '2b297ca1-e672-438a-917a-df2319262bc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:71:09', 'vm-uuid': 'b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:37 user nova-compute[71692]: INFO os_vif [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6')
Apr 13 19:07:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json -f qcow2" returned: 0 in 0.149s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.146s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp5ww6_gv/2b24db2037434cd38f0681e02c2d630d.delta 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:37 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpp5ww6_gv/2b24db2037434cd38f0681e02c2d630d.delta 1073741824" returned: 0 in 0.050s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:37 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 19:07:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:07:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:07:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 19:07:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:07:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:07:38 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:07:38 user nova-compute[71692]: DEBUG nova.objects.instance [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lazy-loading 'info_cache' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:07:38 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 19:07:38 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating instance_info_cache with network_info: [{"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:07:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:07:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:07:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:07:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 19:07:39 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 19:07:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:39 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:07:39 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:07:39 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:07:39 user nova-compute[71692]: DEBUG nova.privsep.utils [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 19:07:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp5ww6_gv/2b24db2037434cd38f0681e02c2d630d.delta /opt/stack/data/nova/instances/snapshots/tmpp5ww6_gv/2b24db2037434cd38f0681e02c2d630d {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:39 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:07:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-e2ebec5c-9c61-4375-8e86-868d0616b3d4 req-33ef351b-8e21-4fdd-985d-f1c98b0a8679 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:07:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e2ebec5c-9c61-4375-8e86-868d0616b3d4 req-33ef351b-8e21-4fdd-985d-f1c98b0a8679 service nova] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e2ebec5c-9c61-4375-8e86-868d0616b3d4 req-33ef351b-8e21-4fdd-985d-f1c98b0a8679 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e2ebec5c-9c61-4375-8e86-868d0616b3d4 req-33ef351b-8e21-4fdd-985d-f1c98b0a8679 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-e2ebec5c-9c61-4375-8e86-868d0616b3d4 req-33ef351b-8e21-4fdd-985d-f1c98b0a8679 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] No waiting events found dispatching network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:07:39 user nova-compute[71692]: WARNING nova.compute.manager [req-e2ebec5c-9c61-4375-8e86-868d0616b3d4 req-33ef351b-8e21-4fdd-985d-f1c98b0a8679 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received unexpected event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 for instance with vm_state resized and task_state resize_reverting.
Apr 13 19:07:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpp5ww6_gv/2b24db2037434cd38f0681e02c2d630d.delta /opt/stack/data/nova/instances/snapshots/tmpp5ww6_gv/2b24db2037434cd38f0681e02c2d630d" returned: 0 in 0.298s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:39 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Snapshot extracted, beginning image upload
Apr 13 19:07:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Removed pending event for b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 due to event {{(pid=71692) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 19:07:41 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412861.342071, b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:07:41 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] VM Resumed (Lifecycle Event)
Apr 13 19:07:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:07:41 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Instance running successfully.
Apr 13 19:07:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] finish_revert_migration finished successfully. {{(pid=71692) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 13 19:07:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:07:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:07:41 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 13 19:07:41 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412861.3435178, b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:07:41 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] VM Started (Lifecycle Event)
Apr 13 19:07:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:07:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:07:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-16f1ada7-4c59-4c20-af0e-170d6083acd8 req-1bb0591d-7055-48c6-9894-e9d283573e1b service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:07:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-16f1ada7-4c59-4c20-af0e-170d6083acd8 req-1bb0591d-7055-48c6-9894-e9d283573e1b service nova] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-16f1ada7-4c59-4c20-af0e-170d6083acd8 req-1bb0591d-7055-48c6-9894-e9d283573e1b service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-16f1ada7-4c59-4c20-af0e-170d6083acd8 req-1bb0591d-7055-48c6-9894-e9d283573e1b service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-16f1ada7-4c59-4c20-af0e-170d6083acd8 req-1bb0591d-7055-48c6-9894-e9d283573e1b service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] No waiting events found dispatching network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:07:41 user nova-compute[71692]: WARNING nova.compute.manager [req-16f1ada7-4c59-4c20-af0e-170d6083acd8 req-1bb0591d-7055-48c6-9894-e9d283573e1b service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received unexpected event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 for instance with vm_state resized and task_state resize_reverting.
Apr 13 19:07:41 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 13 19:07:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:41 user nova-compute[71692]: INFO nova.compute.manager [None req-3bf7c6ef-3658-4473-9729-a173ef9ff3e1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating instance to original state: 'active'
Apr 13 19:07:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:42 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Snapshot image upload complete
Apr 13 19:07:42 user nova-compute[71692]: INFO nova.compute.manager [None req-00befd16-656f-4390-86f2-28a67f462abe tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Took 5.19 seconds to snapshot the instance on the hypervisor.
Apr 13 19:07:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:07:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:07:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:07:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:07:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:07:44 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:07:44 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=7977MB free_disk=26.231643676757812GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 59d7b86a-c723-4255-827e-2f6a641239df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance cb3fb753-ff8d-4dac-ab70-f940233bf25d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing inventories for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating ProviderTree inventory for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating inventory in ProviderTree for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing aggregate associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, aggregates: None {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing trait associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.669s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 19:07:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] There are 0 instances to clean {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 19:07:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "32751522-5725-4cb4-a8bd-234dfe84780b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "32751522-5725-4cb4-a8bd-234dfe84780b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:07:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:07:47 user nova-compute[71692]: INFO nova.compute.claims [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Claim successful on node user
Apr 13 19:07:48 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:07:48 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:07:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:48 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:07:48 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:07:48 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:07:48 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:07:48 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:07:48 user nova-compute[71692]: DEBUG nova.policy [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb7bcc69770a4859904f1b66cece61e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3347c59f4ca945399a4323e689460d12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:07:48 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:07:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:07:48 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Creating image(s)
Apr 13 19:07:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "/opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "/opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "/opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "5755f82ac4df8484bcdb94e991d129d0191c42a2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "5755f82ac4df8484bcdb94e991d129d0191c42a2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2.part --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Successfully created port: 24610878-c15b-4646-9dcf-ef49c99ae208 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2.part --force-share --output=json" returned: 0 in 0.149s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG nova.virt.images [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 9d6be829-be2c-4e1a-bcdd-c919a67a76ec was qcow2, converting to raw {{(pid=71692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG nova.privsep.utils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2.part /opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2.converted {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2.part /opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2.converted" returned: 0 in 0.154s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2.converted --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "5755f82ac4df8484bcdb94e991d129d0191c42a2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.077s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2 --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "5755f82ac4df8484bcdb94e991d129d0191c42a2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "5755f82ac4df8484bcdb94e991d129d0191c42a2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2 --force-share --output=json" returned: 0 in 0.138s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2,backing_fmt=raw /opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2,backing_fmt=raw /opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b/disk 1073741824" returned: 0 in 0.055s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "5755f82ac4df8484bcdb94e991d129d0191c42a2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Successfully updated port: 24610878-c15b-4646-9dcf-ef49c99ae208 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG nova.compute.manager [req-50e15944-643a-482d-8277-31c42d37245a req-29564279-6a55-4b63-ab8a-6442e30a491a service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Received event network-changed-24610878-c15b-4646-9dcf-ef49c99ae208 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG nova.compute.manager [req-50e15944-643a-482d-8277-31c42d37245a req-29564279-6a55-4b63-ab8a-6442e30a491a service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Refreshing instance network info cache due to event network-changed-24610878-c15b-4646-9dcf-ef49c99ae208. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-50e15944-643a-482d-8277-31c42d37245a req-29564279-6a55-4b63-ab8a-6442e30a491a service nova] Acquiring lock "refresh_cache-32751522-5725-4cb4-a8bd-234dfe84780b" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-50e15944-643a-482d-8277-31c42d37245a req-29564279-6a55-4b63-ab8a-6442e30a491a service nova] Acquired lock "refresh_cache-32751522-5725-4cb4-a8bd-234dfe84780b" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG nova.network.neutron [req-50e15944-643a-482d-8277-31c42d37245a req-29564279-6a55-4b63-ab8a-6442e30a491a service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Refreshing network info cache for port 24610878-c15b-4646-9dcf-ef49c99ae208 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:07:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "refresh_cache-32751522-5725-4cb4-a8bd-234dfe84780b" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.network.neutron [req-50e15944-643a-482d-8277-31c42d37245a req-29564279-6a55-4b63-ab8a-6442e30a491a service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2 --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.objects.instance [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lazy-loading 'migration_context' on Instance uuid 32751522-5725-4cb4-a8bd-234dfe84780b {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Ensure instance console log exists: /opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.network.neutron [req-50e15944-643a-482d-8277-31c42d37245a req-29564279-6a55-4b63-ab8a-6442e30a491a service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-50e15944-643a-482d-8277-31c42d37245a req-29564279-6a55-4b63-ab8a-6442e30a491a service nova] Releasing lock "refresh_cache-32751522-5725-4cb4-a8bd-234dfe84780b" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquired lock "refresh_cache-32751522-5725-4cb4-a8bd-234dfe84780b" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Updating instance_info_cache with network_info: [{"id": "24610878-c15b-4646-9dcf-ef49c99ae208", "address": "fa:16:3e:42:91:a8", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24610878-c1", "ovs_interfaceid": "24610878-c15b-4646-9dcf-ef49c99ae208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Releasing lock "refresh_cache-32751522-5725-4cb4-a8bd-234dfe84780b" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Instance network_info: |[{"id": "24610878-c15b-4646-9dcf-ef49c99ae208", "address": "fa:16:3e:42:91:a8", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24610878-c1", "ovs_interfaceid": "24610878-c15b-4646-9dcf-ef49c99ae208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Start _get_guest_xml network_info=[{"id": "24610878-c15b-4646-9dcf-ef49c99ae208", "address": "fa:16:3e:42:91:a8", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24610878-c1", "ovs_interfaceid": "24610878-c15b-4646-9dcf-ef49c99ae208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='cde749739712e24d7bdf5bc4188377d9',container_format='bare',created_at=2023-04-13T19:07:37Z,direct_url=<?>,disk_format='qcow2',id=9d6be829-be2c-4e1a-bcdd-c919a67a76ec,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1463536675',owner='3347c59f4ca945399a4323e689460d12',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-13T19:07:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': '9d6be829-be2c-4e1a-bcdd-c919a67a76ec'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:07:50 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:07:50 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cde749739712e24d7bdf5bc4188377d9',container_format='bare',created_at=2023-04-13T19:07:37Z,direct_url=<?>,disk_format='qcow2',id=9d6be829-be2c-4e1a-bcdd-c919a67a76ec,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1463536675',owner='3347c59f4ca945399a4323e689460d12',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-13T19:07:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-386852633',display_name='tempest-TestStampPattern-server-386852633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-386852633',id=21,image_ref='9d6be829-be2c-4e1a-bcdd-c919a67a76ec',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHlW3C03mbx8npnGQJlBa+Z8VKTTGNO9FQPBpbP73f2RM1T737WN8fLrDdW9N64l6RsTGIQydByfuY41AlVN9GkKHEdIxhoJ63MlO2Jt2MVwCLy66RUUbGjTxXc1hX0iw==',key_name='tempest-TestStampPattern-550784019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3347c59f4ca945399a4323e689460d12',ramdisk_id='',reservation_id='r-7702wosi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='cb3fb753-ff8d-4dac-ab70-f940233bf25d',image_min_disk='1',image_min_ram='0',image_owner_id='3347c59f4ca945399a4323e689460d12',image_owner_project_name='tempest-TestStampPattern-456915878',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-456915878-project-member',image_user_id='cb7bcc69770a4859904f1b66cece61e3',network_allocated='True',owner_project_name='tempest-TestStampPattern-456915878',owner_user_name='tempest-TestStampPattern-456915878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:07:48Z,user_data=None,user_id='cb7bcc69770a4859904f1b66cece61e3',uuid=32751522-5725-4cb4-a8bd-234dfe84780b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24610878-c15b-4646-9dcf-ef49c99ae208", "address": "fa:16:3e:42:91:a8", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24610878-c1", "ovs_interfaceid": "24610878-c15b-4646-9dcf-ef49c99ae208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Converting VIF {"id": "24610878-c15b-4646-9dcf-ef49c99ae208", "address": "fa:16:3e:42:91:a8", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24610878-c1", "ovs_interfaceid": "24610878-c15b-4646-9dcf-ef49c99ae208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:91:a8,bridge_name='br-int',has_traffic_filtering=True,id=24610878-c15b-4646-9dcf-ef49c99ae208,network=Network(a5157bcb-9174-46af-b786-e4b159907e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24610878-c1') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.objects.instance [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lazy-loading 'pci_devices' on Instance uuid 32751522-5725-4cb4-a8bd-234dfe84780b {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:07:50 user nova-compute[71692]:   <uuid>32751522-5725-4cb4-a8bd-234dfe84780b</uuid>
Apr 13 19:07:50 user nova-compute[71692]:   <name>instance-00000015</name>
Apr 13 19:07:50 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:07:50 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:07:50 user nova-compute[71692]:   <metadata>
Apr 13 19:07:50 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:07:50 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:07:50 user nova-compute[71692]:       <nova:name>tempest-TestStampPattern-server-386852633</nova:name>
Apr 13 19:07:50 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:07:50</nova:creationTime>
Apr 13 19:07:50 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:07:50 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:07:50 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:07:50 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:07:50 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:07:50 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:07:50 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:07:50 user nova-compute[71692]:       <nova:owner>
Apr 13 19:07:50 user nova-compute[71692]:         <nova:user uuid="cb7bcc69770a4859904f1b66cece61e3">tempest-TestStampPattern-456915878-project-member</nova:user>
Apr 13 19:07:50 user nova-compute[71692]:         <nova:project uuid="3347c59f4ca945399a4323e689460d12">tempest-TestStampPattern-456915878</nova:project>
Apr 13 19:07:50 user nova-compute[71692]:       </nova:owner>
Apr 13 19:07:50 user nova-compute[71692]:       <nova:root type="image" uuid="9d6be829-be2c-4e1a-bcdd-c919a67a76ec"/>
Apr 13 19:07:50 user nova-compute[71692]:       <nova:ports>
Apr 13 19:07:50 user nova-compute[71692]:         <nova:port uuid="24610878-c15b-4646-9dcf-ef49c99ae208">
Apr 13 19:07:50 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 19:07:50 user nova-compute[71692]:         </nova:port>
Apr 13 19:07:50 user nova-compute[71692]:       </nova:ports>
Apr 13 19:07:50 user nova-compute[71692]:     </nova:instance>
Apr 13 19:07:50 user nova-compute[71692]:   </metadata>
Apr 13 19:07:50 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:07:50 user nova-compute[71692]:     <system>
Apr 13 19:07:50 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:07:50 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:07:50 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:07:50 user nova-compute[71692]:       <entry name="serial">32751522-5725-4cb4-a8bd-234dfe84780b</entry>
Apr 13 19:07:50 user nova-compute[71692]:       <entry name="uuid">32751522-5725-4cb4-a8bd-234dfe84780b</entry>
Apr 13 19:07:50 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:07:50 user nova-compute[71692]:     </system>
Apr 13 19:07:50 user nova-compute[71692]:   </sysinfo>
Apr 13 19:07:50 user nova-compute[71692]:   <os>
Apr 13 19:07:50 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:07:50 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:07:50 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:07:50 user nova-compute[71692]:   </os>
Apr 13 19:07:50 user nova-compute[71692]:   <features>
Apr 13 19:07:50 user nova-compute[71692]:     <acpi/>
Apr 13 19:07:50 user nova-compute[71692]:     <apic/>
Apr 13 19:07:50 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:07:50 user nova-compute[71692]:   </features>
Apr 13 19:07:50 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:07:50 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:07:50 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:07:50 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:07:50 user nova-compute[71692]:   </clock>
Apr 13 19:07:50 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:07:50 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:07:50 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:07:50 user nova-compute[71692]:   </cpu>
Apr 13 19:07:50 user nova-compute[71692]:   <devices>
Apr 13 19:07:50 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:07:50 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:07:50 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b/disk"/>
Apr 13 19:07:50 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:07:50 user nova-compute[71692]:     </disk>
Apr 13 19:07:50 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:07:50 user nova-compute[71692]:       <mac address="fa:16:3e:42:91:a8"/>
Apr 13 19:07:50 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:07:50 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:07:50 user nova-compute[71692]:       <target dev="tap24610878-c1"/>
Apr 13 19:07:50 user nova-compute[71692]:     </interface>
Apr 13 19:07:50 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:07:50 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b/console.log" append="off"/>
Apr 13 19:07:50 user nova-compute[71692]:     </serial>
Apr 13 19:07:50 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:07:50 user nova-compute[71692]:     <video>
Apr 13 19:07:50 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:07:50 user nova-compute[71692]:     </video>
Apr 13 19:07:50 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:07:50 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:07:50 user nova-compute[71692]:     </rng>
Apr 13 19:07:50 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:07:50 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:07:50 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:07:50 user nova-compute[71692]:     </memballoon>
Apr 13 19:07:50 user nova-compute[71692]:   </devices>
Apr 13 19:07:50 user nova-compute[71692]: </domain>
Apr 13 19:07:50 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-386852633',display_name='tempest-TestStampPattern-server-386852633',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-386852633',id=21,image_ref='9d6be829-be2c-4e1a-bcdd-c919a67a76ec',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHlW3C03mbx8npnGQJlBa+Z8VKTTGNO9FQPBpbP73f2RM1T737WN8fLrDdW9N64l6RsTGIQydByfuY41AlVN9GkKHEdIxhoJ63MlO2Jt2MVwCLy66RUUbGjTxXc1hX0iw==',key_name='tempest-TestStampPattern-550784019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3347c59f4ca945399a4323e689460d12',ramdisk_id='',reservation_id='r-7702wosi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='cb3fb753-ff8d-4dac-ab70-f940233bf25d',image_min_disk='1',image_min_ram='0',image_owner_id='3347c59f4ca945399a4323e689460d12',image_owner_project_name='tempest-TestStampPattern-456915878',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-456915878-project-member',image_user_id='cb7bcc69770a4859904f1b66cece61e3',network_allocated='True',owner_project_name='tempest-TestStampPattern-456915878',owner_user_name='tempest-TestStampPattern-456915878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:07:48Z,user_data=None,user_id='cb7bcc69770a4859904f1b66cece61e3',uuid=32751522-5725-4cb4-a8bd-234dfe84780b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24610878-c15b-4646-9dcf-ef49c99ae208", "address": "fa:16:3e:42:91:a8", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24610878-c1", "ovs_interfaceid": "24610878-c15b-4646-9dcf-ef49c99ae208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Converting VIF {"id": "24610878-c15b-4646-9dcf-ef49c99ae208", "address": "fa:16:3e:42:91:a8", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24610878-c1", "ovs_interfaceid": "24610878-c15b-4646-9dcf-ef49c99ae208", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:91:a8,bridge_name='br-int',has_traffic_filtering=True,id=24610878-c15b-4646-9dcf-ef49c99ae208,network=Network(a5157bcb-9174-46af-b786-e4b159907e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24610878-c1') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG os_vif [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:91:a8,bridge_name='br-int',has_traffic_filtering=True,id=24610878-c15b-4646-9dcf-ef49c99ae208,network=Network(a5157bcb-9174-46af-b786-e4b159907e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24610878-c1') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24610878-c1, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap24610878-c1, col_values=(('external_ids', {'iface-id': '24610878-c15b-4646-9dcf-ef49c99ae208', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:91:a8', 'vm-uuid': '32751522-5725-4cb4-a8bd-234dfe84780b'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:50 user nova-compute[71692]: INFO os_vif [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:91:a8,bridge_name='br-int',has_traffic_filtering=True,id=24610878-c15b-4646-9dcf-ef49c99ae208,network=Network(a5157bcb-9174-46af-b786-e4b159907e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24610878-c1')
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:07:50 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] No VIF found with MAC fa:16:3e:42:91:a8, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:07:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:52 user nova-compute[71692]: DEBUG nova.compute.manager [req-a06b07a6-98e9-4591-a9a9-a768ee0885fb req-6e41545d-2953-44ba-a1d9-049baaeb6323 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Received event network-vif-plugged-24610878-c15b-4646-9dcf-ef49c99ae208 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:07:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a06b07a6-98e9-4591-a9a9-a768ee0885fb req-6e41545d-2953-44ba-a1d9-049baaeb6323 service nova] Acquiring lock "32751522-5725-4cb4-a8bd-234dfe84780b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a06b07a6-98e9-4591-a9a9-a768ee0885fb req-6e41545d-2953-44ba-a1d9-049baaeb6323 service nova] Lock "32751522-5725-4cb4-a8bd-234dfe84780b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a06b07a6-98e9-4591-a9a9-a768ee0885fb req-6e41545d-2953-44ba-a1d9-049baaeb6323 service nova] Lock "32751522-5725-4cb4-a8bd-234dfe84780b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:52 user nova-compute[71692]: DEBUG nova.compute.manager [req-a06b07a6-98e9-4591-a9a9-a768ee0885fb req-6e41545d-2953-44ba-a1d9-049baaeb6323 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] No waiting events found dispatching network-vif-plugged-24610878-c15b-4646-9dcf-ef49c99ae208 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:07:52 user nova-compute[71692]: WARNING nova.compute.manager [req-a06b07a6-98e9-4591-a9a9-a768ee0885fb req-6e41545d-2953-44ba-a1d9-049baaeb6323 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Received unexpected event network-vif-plugged-24610878-c15b-4646-9dcf-ef49c99ae208 for instance with vm_state building and task_state spawning.
Apr 13 19:07:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:54 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412874.1906023, 32751522-5725-4cb4-a8bd-234dfe84780b => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:07:54 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] VM Resumed (Lifecycle Event)
Apr 13 19:07:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:07:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:07:54 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Instance spawned successfully.
Apr 13 19:07:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:07:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:07:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:07:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:07:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:07:54 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:07:54 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412874.1918476, 32751522-5725-4cb4-a8bd-234dfe84780b => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:07:54 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] VM Started (Lifecycle Event)
Apr 13 19:07:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-d1bf0094-bf05-4596-b910-72082326ee11 req-c325723b-421a-43c1-bd36-174beb57f9c9 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Received event network-vif-plugged-24610878-c15b-4646-9dcf-ef49c99ae208 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:07:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d1bf0094-bf05-4596-b910-72082326ee11 req-c325723b-421a-43c1-bd36-174beb57f9c9 service nova] Acquiring lock "32751522-5725-4cb4-a8bd-234dfe84780b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d1bf0094-bf05-4596-b910-72082326ee11 req-c325723b-421a-43c1-bd36-174beb57f9c9 service nova] Lock "32751522-5725-4cb4-a8bd-234dfe84780b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d1bf0094-bf05-4596-b910-72082326ee11 req-c325723b-421a-43c1-bd36-174beb57f9c9 service nova] Lock "32751522-5725-4cb4-a8bd-234dfe84780b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-d1bf0094-bf05-4596-b910-72082326ee11 req-c325723b-421a-43c1-bd36-174beb57f9c9 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] No waiting events found dispatching network-vif-plugged-24610878-c15b-4646-9dcf-ef49c99ae208 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:07:54 user nova-compute[71692]: WARNING nova.compute.manager [req-d1bf0094-bf05-4596-b910-72082326ee11 req-c325723b-421a-43c1-bd36-174beb57f9c9 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Received unexpected event network-vif-plugged-24610878-c15b-4646-9dcf-ef49c99ae208 for instance with vm_state building and task_state spawning.
Apr 13 19:07:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:07:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:07:54 user nova-compute[71692]: INFO nova.compute.manager [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Took 5.85 seconds to spawn the instance on the hypervisor.
Apr 13 19:07:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:07:54 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:07:54 user nova-compute[71692]: INFO nova.compute.manager [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Took 6.57 seconds to build instance.
Apr 13 19:07:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d145e5cc-d4e3-40d3-a22f-9811005667bb tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "32751522-5725-4cb4-a8bd-234dfe84780b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.673s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:07:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:56 user nova-compute[71692]: INFO nova.compute.manager [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Unshelving
Apr 13 19:07:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:56 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'pci_requests' on Instance uuid 2c2e4899-d6d5-422c-a4f1-61a8129abdae {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:07:56 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'numa_topology' on Instance uuid 2c2e4899-d6d5-422c-a4f1-61a8129abdae {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:07:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:07:56 user nova-compute[71692]: INFO nova.compute.claims [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Claim successful on node user
Apr 13 19:07:56 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:07:56 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:07:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:56 user nova-compute[71692]: INFO nova.network.neutron [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Updating port 071fd8c9-9400-42aa-ad88-1176bb1d4910 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 19:07:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:07:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquired lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:07:57 user nova-compute[71692]: DEBUG nova.network.neutron [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:07:57 user nova-compute[71692]: DEBUG nova.compute.manager [req-540cb7a9-1a74-44b2-a275-54152d3ecff4 req-7bdc1a74-425f-4d70-9c0f-679bee770d0a service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-changed-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:07:57 user nova-compute[71692]: DEBUG nova.compute.manager [req-540cb7a9-1a74-44b2-a275-54152d3ecff4 req-7bdc1a74-425f-4d70-9c0f-679bee770d0a service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Refreshing instance network info cache due to event network-changed-071fd8c9-9400-42aa-ad88-1176bb1d4910. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:07:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-540cb7a9-1a74-44b2-a275-54152d3ecff4 req-7bdc1a74-425f-4d70-9c0f-679bee770d0a service nova] Acquiring lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:07:58 user nova-compute[71692]: DEBUG nova.network.neutron [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Updating instance_info_cache with network_info: [{"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:07:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Releasing lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:07:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:07:58 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Creating image(s)
Apr 13 19:07:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "/opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "/opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:58 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2c2e4899-d6d5-422c-a4f1-61a8129abdae {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:07:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-540cb7a9-1a74-44b2-a275-54152d3ecff4 req-7bdc1a74-425f-4d70-9c0f-679bee770d0a service nova] Acquired lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:07:58 user nova-compute[71692]: DEBUG nova.network.neutron [req-540cb7a9-1a74-44b2-a275-54152d3ecff4 req-7bdc1a74-425f-4d70-9c0f-679bee770d0a service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Refreshing network info cache for port 071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:07:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "24e8767c09f24c5dc5936d0959fad5c545c0e92d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "24e8767c09f24c5dc5936d0959fad5c545c0e92d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d.part --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d.part --force-share --output=json" returned: 0 in 0.407s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG nova.virt.images [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] 80bef666-ea86-4e4b-94a6-dad9533d2d25 was qcow2, converting to raw {{(pid=71692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG nova.privsep.utils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d.part /opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d.converted {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG nova.network.neutron [req-540cb7a9-1a74-44b2-a275-54152d3ecff4 req-7bdc1a74-425f-4d70-9c0f-679bee770d0a service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Updated VIF entry in instance network info cache for port 071fd8c9-9400-42aa-ad88-1176bb1d4910. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG nova.network.neutron [req-540cb7a9-1a74-44b2-a275-54152d3ecff4 req-7bdc1a74-425f-4d70-9c0f-679bee770d0a service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Updating instance_info_cache with network_info: [{"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-540cb7a9-1a74-44b2-a275-54152d3ecff4 req-7bdc1a74-425f-4d70-9c0f-679bee770d0a service nova] Releasing lock "refresh_cache-2c2e4899-d6d5-422c-a4f1-61a8129abdae" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d.part /opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d.converted" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d.converted --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "24e8767c09f24c5dc5936d0959fad5c545c0e92d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.275s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "24e8767c09f24c5dc5936d0959fad5c545c0e92d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "24e8767c09f24c5dc5936d0959fad5c545c0e92d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d --force-share --output=json" returned: 0 in 0.129s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:07:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d,backing_fmt=raw /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d,backing_fmt=raw /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk 1073741824" returned: 0 in 0.048s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "24e8767c09f24c5dc5936d0959fad5c545c0e92d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d --force-share --output=json" returned: 0 in 0.130s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:00 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'migration_context' on Instance uuid 2c2e4899-d6d5-422c-a4f1-61a8129abdae {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:08:00 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Rebasing disk image.
Apr 13 19:08:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 -F raw /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 -F raw /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk" returned: 0 in 1.985s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Ensure instance console log exists: /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Start _get_guest_xml network_info=[{"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ce735c16a382bc8203cfd1008d9b8897',container_format='bare',created_at=2023-04-13T19:06:04Z,direct_url=<?>,disk_format='qcow2',id=80bef666-ea86-4e4b-94a6-dad9533d2d25,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1141253084-shelved',owner='faabdcc8e61c452ab3b934b1c9501e68',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T19:06:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:08:02 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:08:02 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ce735c16a382bc8203cfd1008d9b8897',container_format='bare',created_at=2023-04-13T19:06:04Z,direct_url=<?>,disk_format='qcow2',id=80bef666-ea86-4e4b-94a6-dad9533d2d25,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1141253084-shelved',owner='faabdcc8e61c452ab3b934b1c9501e68',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T19:06:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2c2e4899-d6d5-422c-a4f1-61a8129abdae {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T19:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1141253084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1141253084',id=16,image_ref='80bef666-ea86-4e4b-94a6-dad9533d2d25',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1280930280',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:04:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='faabdcc8e61c452ab3b934b1c9501e68',ramdisk_id='',reservation_id='r-r0g030ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1546308967',owner_user_name='tempest-AttachVolumeShelveTestJSON-1546308967-project-member',shelved_at='2023-04-13T19:06:07.645777',shelved_host='user',shelved_image_id='80bef666-ea86-4e4b-94a6-dad9533d2d25'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:07:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee6c76c605d54b4f84e0596b27087f0b',uuid=2c2e4899-d6d5-422c-a4f1-61a8129abdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converting VIF {"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:dd:1f,bridge_name='br-int',has_traffic_filtering=True,id=071fd8c9-9400-42aa-ad88-1176bb1d4910,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071fd8c9-94') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c2e4899-d6d5-422c-a4f1-61a8129abdae {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:08:02 user nova-compute[71692]:   <uuid>2c2e4899-d6d5-422c-a4f1-61a8129abdae</uuid>
Apr 13 19:08:02 user nova-compute[71692]:   <name>instance-00000010</name>
Apr 13 19:08:02 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:08:02 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:08:02 user nova-compute[71692]:   <metadata>
Apr 13 19:08:02 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:08:02 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:08:02 user nova-compute[71692]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1141253084</nova:name>
Apr 13 19:08:02 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:08:02</nova:creationTime>
Apr 13 19:08:02 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:08:02 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:08:02 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:08:02 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:08:02 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:08:02 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:08:02 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:08:02 user nova-compute[71692]:       <nova:owner>
Apr 13 19:08:02 user nova-compute[71692]:         <nova:user uuid="ee6c76c605d54b4f84e0596b27087f0b">tempest-AttachVolumeShelveTestJSON-1546308967-project-member</nova:user>
Apr 13 19:08:02 user nova-compute[71692]:         <nova:project uuid="faabdcc8e61c452ab3b934b1c9501e68">tempest-AttachVolumeShelveTestJSON-1546308967</nova:project>
Apr 13 19:08:02 user nova-compute[71692]:       </nova:owner>
Apr 13 19:08:02 user nova-compute[71692]:       <nova:root type="image" uuid="80bef666-ea86-4e4b-94a6-dad9533d2d25"/>
Apr 13 19:08:02 user nova-compute[71692]:       <nova:ports>
Apr 13 19:08:02 user nova-compute[71692]:         <nova:port uuid="071fd8c9-9400-42aa-ad88-1176bb1d4910">
Apr 13 19:08:02 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 19:08:02 user nova-compute[71692]:         </nova:port>
Apr 13 19:08:02 user nova-compute[71692]:       </nova:ports>
Apr 13 19:08:02 user nova-compute[71692]:     </nova:instance>
Apr 13 19:08:02 user nova-compute[71692]:   </metadata>
Apr 13 19:08:02 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:08:02 user nova-compute[71692]:     <system>
Apr 13 19:08:02 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:08:02 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:08:02 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:08:02 user nova-compute[71692]:       <entry name="serial">2c2e4899-d6d5-422c-a4f1-61a8129abdae</entry>
Apr 13 19:08:02 user nova-compute[71692]:       <entry name="uuid">2c2e4899-d6d5-422c-a4f1-61a8129abdae</entry>
Apr 13 19:08:02 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:08:02 user nova-compute[71692]:     </system>
Apr 13 19:08:02 user nova-compute[71692]:   </sysinfo>
Apr 13 19:08:02 user nova-compute[71692]:   <os>
Apr 13 19:08:02 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:08:02 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:08:02 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:08:02 user nova-compute[71692]:   </os>
Apr 13 19:08:02 user nova-compute[71692]:   <features>
Apr 13 19:08:02 user nova-compute[71692]:     <acpi/>
Apr 13 19:08:02 user nova-compute[71692]:     <apic/>
Apr 13 19:08:02 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:08:02 user nova-compute[71692]:   </features>
Apr 13 19:08:02 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:08:02 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:08:02 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:08:02 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:08:02 user nova-compute[71692]:   </clock>
Apr 13 19:08:02 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:08:02 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:08:02 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:08:02 user nova-compute[71692]:   </cpu>
Apr 13 19:08:02 user nova-compute[71692]:   <devices>
Apr 13 19:08:02 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:08:02 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:08:02 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk"/>
Apr 13 19:08:02 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:08:02 user nova-compute[71692]:     </disk>
Apr 13 19:08:02 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:08:02 user nova-compute[71692]:       <mac address="fa:16:3e:bd:dd:1f"/>
Apr 13 19:08:02 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:08:02 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:08:02 user nova-compute[71692]:       <target dev="tap071fd8c9-94"/>
Apr 13 19:08:02 user nova-compute[71692]:     </interface>
Apr 13 19:08:02 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:08:02 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/console.log" append="off"/>
Apr 13 19:08:02 user nova-compute[71692]:     </serial>
Apr 13 19:08:02 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:08:02 user nova-compute[71692]:     <video>
Apr 13 19:08:02 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:08:02 user nova-compute[71692]:     </video>
Apr 13 19:08:02 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:08:02 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:08:02 user nova-compute[71692]:     </rng>
Apr 13 19:08:02 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:08:02 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:08:02 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:08:02 user nova-compute[71692]:     </memballoon>
Apr 13 19:08:02 user nova-compute[71692]:   </devices>
Apr 13 19:08:02 user nova-compute[71692]: </domain>
Apr 13 19:08:02 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T19:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1141253084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1141253084',id=16,image_ref='80bef666-ea86-4e4b-94a6-dad9533d2d25',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1280930280',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:04:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='faabdcc8e61c452ab3b934b1c9501e68',ramdisk_id='',reservation_id='r-r0g030ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1546308967',owner_user_name='tempest-AttachVolumeShelveTestJSON-1546308967-project-member',shelved_at='2023-04-13T19:06:07.645777',shelved_host='user',shelved_image_id='80bef666-ea86-4e4b-94a6-dad9533d2d25'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:07:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee6c76c605d54b4f84e0596b27087f0b',uuid=2c2e4899-d6d5-422c-a4f1-61a8129abdae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converting VIF {"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:dd:1f,bridge_name='br-int',has_traffic_filtering=True,id=071fd8c9-9400-42aa-ad88-1176bb1d4910,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071fd8c9-94') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG os_vif [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:dd:1f,bridge_name='br-int',has_traffic_filtering=True,id=071fd8c9-9400-42aa-ad88-1176bb1d4910,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071fd8c9-94') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap071fd8c9-94, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap071fd8c9-94, col_values=(('external_ids', {'iface-id': '071fd8c9-9400-42aa-ad88-1176bb1d4910', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:dd:1f', 'vm-uuid': '2c2e4899-d6d5-422c-a4f1-61a8129abdae'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:02 user nova-compute[71692]: INFO os_vif [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:dd:1f,bridge_name='br-int',has_traffic_filtering=True,id=071fd8c9-9400-42aa-ad88-1176bb1d4910,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071fd8c9-94')
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:08:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] No VIF found with MAC fa:16:3e:bd:dd:1f, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:08:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-1ae1dc17-fbf9-4956-95f1-84f8e63ae19b req-772c7232-a61f-4112-95f7-fe9a1b3f4f0a service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1ae1dc17-fbf9-4956-95f1-84f8e63ae19b req-772c7232-a61f-4112-95f7-fe9a1b3f4f0a service nova] Acquiring lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1ae1dc17-fbf9-4956-95f1-84f8e63ae19b req-772c7232-a61f-4112-95f7-fe9a1b3f4f0a service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1ae1dc17-fbf9-4956-95f1-84f8e63ae19b req-772c7232-a61f-4112-95f7-fe9a1b3f4f0a service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-1ae1dc17-fbf9-4956-95f1-84f8e63ae19b req-772c7232-a61f-4112-95f7-fe9a1b3f4f0a service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] No waiting events found dispatching network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:04 user nova-compute[71692]: WARNING nova.compute.manager [req-1ae1dc17-fbf9-4956-95f1-84f8e63ae19b req-772c7232-a61f-4112-95f7-fe9a1b3f4f0a service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received unexpected event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 19:08:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-67a1e4da-6578-4268-a09a-25b07fd49a7a req-3b27e999-a85d-44d4-aaa5-5b6d0e1f226f service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-67a1e4da-6578-4268-a09a-25b07fd49a7a req-3b27e999-a85d-44d4-aaa5-5b6d0e1f226f service nova] Acquiring lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-67a1e4da-6578-4268-a09a-25b07fd49a7a req-3b27e999-a85d-44d4-aaa5-5b6d0e1f226f service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-67a1e4da-6578-4268-a09a-25b07fd49a7a req-3b27e999-a85d-44d4-aaa5-5b6d0e1f226f service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-67a1e4da-6578-4268-a09a-25b07fd49a7a req-3b27e999-a85d-44d4-aaa5-5b6d0e1f226f service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] No waiting events found dispatching network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:06 user nova-compute[71692]: WARNING nova.compute.manager [req-67a1e4da-6578-4268-a09a-25b07fd49a7a req-3b27e999-a85d-44d4-aaa5-5b6d0e1f226f service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received unexpected event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 19:08:06 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412886.4071643, 2c2e4899-d6d5-422c-a4f1-61a8129abdae => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:08:06 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] VM Resumed (Lifecycle Event)
Apr 13 19:08:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:08:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:08:06 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Instance spawned successfully.
Apr 13 19:08:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:08:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:08:06 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:08:06 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412886.4088979, 2c2e4899-d6d5-422c-a4f1-61a8129abdae => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:08:06 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] VM Started (Lifecycle Event)
Apr 13 19:08:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:08:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:08:06 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:08:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:08:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0753c543-8e09-48da-904e-44f3fbfd34c9 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.335s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:08 user nova-compute[71692]: DEBUG nova.compute.manager [req-2f6dd6a3-da7a-422e-899a-f9f4e001199c req-a214a52a-d7f7-4e17-85ba-a393224393a9 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-changed-28b89f9c-8af3-4c33-89a9-55c61aaafe03 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:08 user nova-compute[71692]: DEBUG nova.compute.manager [req-2f6dd6a3-da7a-422e-899a-f9f4e001199c req-a214a52a-d7f7-4e17-85ba-a393224393a9 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Refreshing instance network info cache due to event network-changed-28b89f9c-8af3-4c33-89a9-55c61aaafe03. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:08:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2f6dd6a3-da7a-422e-899a-f9f4e001199c req-a214a52a-d7f7-4e17-85ba-a393224393a9 service nova] Acquiring lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:08:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2f6dd6a3-da7a-422e-899a-f9f4e001199c req-a214a52a-d7f7-4e17-85ba-a393224393a9 service nova] Acquired lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:08:08 user nova-compute[71692]: DEBUG nova.network.neutron [req-2f6dd6a3-da7a-422e-899a-f9f4e001199c req-a214a52a-d7f7-4e17-85ba-a393224393a9 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Refreshing network info cache for port 28b89f9c-8af3-4c33-89a9-55c61aaafe03 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:08:08 user nova-compute[71692]: DEBUG nova.network.neutron [req-2f6dd6a3-da7a-422e-899a-f9f4e001199c req-a214a52a-d7f7-4e17-85ba-a393224393a9 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updated VIF entry in instance network info cache for port 28b89f9c-8af3-4c33-89a9-55c61aaafe03. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:08:08 user nova-compute[71692]: DEBUG nova.network.neutron [req-2f6dd6a3-da7a-422e-899a-f9f4e001199c req-a214a52a-d7f7-4e17-85ba-a393224393a9 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updating instance_info_cache with network_info: [{"id": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "address": "fa:16:3e:5f:cd:f6", "network": {"id": "63a9c9d2-0f2a-4643-b048-dcf2389044cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1932742453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b89f9c-8a", "ovs_interfaceid": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "address": "fa:16:3e:07:f8:b3", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea157b6-07", "ovs_interfaceid": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4f7e511-017c-4a16-8e0c-21f468f87027", "address": "fa:16:3e:4c:50:43", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7e511-01", "ovs_interfaceid": "d4f7e511-017c-4a16-8e0c-21f468f87027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "address": "fa:16:3e:49:07:8e", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9534ad-df", "ovs_interfaceid": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "address": "fa:16:3e:44:c2:9d", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0eb0dff-32", "ovs_interfaceid": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be95859a-0075-4a7d-b4f3-c89c61e54984", "address": "fa:16:3e:1a:a0:c1", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe95859a-00", "ovs_interfaceid": "be95859a-0075-4a7d-b4f3-c89c61e54984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d35454b-179a-4fcc-a56d-445475aa2900", "address": "fa:16:3e:54:0a:10", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d35454b-17", "ovs_interfaceid": "5d35454b-179a-4fcc-a56d-445475aa2900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:08:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2f6dd6a3-da7a-422e-899a-f9f4e001199c req-a214a52a-d7f7-4e17-85ba-a393224393a9 service nova] Releasing lock "refresh_cache-4e2d4287-0adb-4045-b6e8-25095b5d3bbf" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:09 user nova-compute[71692]: INFO nova.compute.manager [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Terminating instance
Apr 13 19:08:09 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG nova.compute.manager [req-41335e95-68bb-40ff-807b-6a9f45d034e5 req-09e0e5c2-0c5d-4e5a-bf14-8e9eb5215ad4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-unplugged-28b89f9c-8af3-4c33-89a9-55c61aaafe03 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-41335e95-68bb-40ff-807b-6a9f45d034e5 req-09e0e5c2-0c5d-4e5a-bf14-8e9eb5215ad4 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-41335e95-68bb-40ff-807b-6a9f45d034e5 req-09e0e5c2-0c5d-4e5a-bf14-8e9eb5215ad4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-41335e95-68bb-40ff-807b-6a9f45d034e5 req-09e0e5c2-0c5d-4e5a-bf14-8e9eb5215ad4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG nova.compute.manager [req-41335e95-68bb-40ff-807b-6a9f45d034e5 req-09e0e5c2-0c5d-4e5a-bf14-8e9eb5215ad4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-unplugged-28b89f9c-8af3-4c33-89a9-55c61aaafe03 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG nova.compute.manager [req-41335e95-68bb-40ff-807b-6a9f45d034e5 req-09e0e5c2-0c5d-4e5a-bf14-8e9eb5215ad4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-unplugged-28b89f9c-8af3-4c33-89a9-55c61aaafe03 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG nova.compute.manager [req-8119e330-8482-4e32-870c-4ef08ede4f8c req-f9db4040-1f6b-438d-9348-45934f307b74 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-unplugged-1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8119e330-8482-4e32-870c-4ef08ede4f8c req-f9db4040-1f6b-438d-9348-45934f307b74 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8119e330-8482-4e32-870c-4ef08ede4f8c req-f9db4040-1f6b-438d-9348-45934f307b74 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8119e330-8482-4e32-870c-4ef08ede4f8c req-f9db4040-1f6b-438d-9348-45934f307b74 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG nova.compute.manager [req-8119e330-8482-4e32-870c-4ef08ede4f8c req-f9db4040-1f6b-438d-9348-45934f307b74 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-unplugged-1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG nova.compute.manager [req-8119e330-8482-4e32-870c-4ef08ede4f8c req-f9db4040-1f6b-438d-9348-45934f307b74 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-unplugged-1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG nova.compute.manager [req-4bca9c59-b041-4a5f-a09c-44c0afa685a7 req-39805ba5-df28-490c-9a9f-79711c4f66e9 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-unplugged-be95859a-0075-4a7d-b4f3-c89c61e54984 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bca9c59-b041-4a5f-a09c-44c0afa685a7 req-39805ba5-df28-490c-9a9f-79711c4f66e9 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bca9c59-b041-4a5f-a09c-44c0afa685a7 req-39805ba5-df28-490c-9a9f-79711c4f66e9 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bca9c59-b041-4a5f-a09c-44c0afa685a7 req-39805ba5-df28-490c-9a9f-79711c4f66e9 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG nova.compute.manager [req-4bca9c59-b041-4a5f-a09c-44c0afa685a7 req-39805ba5-df28-490c-9a9f-79711c4f66e9 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-unplugged-be95859a-0075-4a7d-b4f3-c89c61e54984 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG nova.compute.manager [req-4bca9c59-b041-4a5f-a09c-44c0afa685a7 req-39805ba5-df28-490c-9a9f-79711c4f66e9 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-unplugged-be95859a-0075-4a7d-b4f3-c89c61e54984 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:08:10 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Instance destroyed successfully.
Apr 13 19:08:10 user nova-compute[71692]: DEBUG nova.objects.instance [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lazy-loading 'resources' on Instance uuid 4e2d4287-0adb-4045-b6e8-25095b5d3bbf {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:06:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "address": "fa:16:3e:5f:cd:f6", "network": {"id": "63a9c9d2-0f2a-4643-b048-dcf2389044cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1932742453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b89f9c-8a", "ovs_interfaceid": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "address": "fa:16:3e:5f:cd:f6", "network": {"id": "63a9c9d2-0f2a-4643-b048-dcf2389044cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1932742453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b89f9c-8a", "ovs_interfaceid": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:cd:f6,bridge_name='br-int',has_traffic_filtering=True,id=28b89f9c-8af3-4c33-89a9-55c61aaafe03,network=Network(63a9c9d2-0f2a-4643-b048-dcf2389044cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b89f9c-8a') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG os_vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:cd:f6,bridge_name='br-int',has_traffic_filtering=True,id=28b89f9c-8af3-4c33-89a9-55c61aaafe03,network=Network(63a9c9d2-0f2a-4643-b048-dcf2389044cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b89f9c-8a') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28b89f9c-8a, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:11 user nova-compute[71692]: INFO os_vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:cd:f6,bridge_name='br-int',has_traffic_filtering=True,id=28b89f9c-8af3-4c33-89a9-55c61aaafe03,network=Network(63a9c9d2-0f2a-4643-b048-dcf2389044cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28b89f9c-8a')
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:06:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "address": "fa:16:3e:07:f8:b3", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea157b6-07", "ovs_interfaceid": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "address": "fa:16:3e:07:f8:b3", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea157b6-07", "ovs_interfaceid": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:f8:b3,bridge_name='br-int',has_traffic_filtering=True,id=1ea157b6-07a2-4ff3-b11f-b7ea88de6e12,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1ea157b6-07') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:f8:b3,bridge_name='br-int',has_traffic_filtering=True,id=1ea157b6-07a2-4ff3-b11f-b7ea88de6e12,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1ea157b6-07') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ea157b6-07, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:11 user nova-compute[71692]: INFO os_vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:f8:b3,bridge_name='br-int',has_traffic_filtering=True,id=1ea157b6-07a2-4ff3-b11f-b7ea88de6e12,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1ea157b6-07')
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:06:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4f7e511-017c-4a16-8e0c-21f468f87027", "address": "fa:16:3e:4c:50:43", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7e511-01", "ovs_interfaceid": "d4f7e511-017c-4a16-8e0c-21f468f87027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "d4f7e511-017c-4a16-8e0c-21f468f87027", "address": "fa:16:3e:4c:50:43", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7e511-01", "ovs_interfaceid": "d4f7e511-017c-4a16-8e0c-21f468f87027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:50:43,bridge_name='br-int',has_traffic_filtering=True,id=d4f7e511-017c-4a16-8e0c-21f468f87027,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4f7e511-01') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:50:43,bridge_name='br-int',has_traffic_filtering=True,id=d4f7e511-017c-4a16-8e0c-21f468f87027,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4f7e511-01') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4f7e511-01, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:11 user nova-compute[71692]: INFO os_vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:50:43,bridge_name='br-int',has_traffic_filtering=True,id=d4f7e511-017c-4a16-8e0c-21f468f87027,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4f7e511-01')
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:06:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "address": "fa:16:3e:49:07:8e", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9534ad-df", "ovs_interfaceid": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "address": "fa:16:3e:49:07:8e", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9534ad-df", "ovs_interfaceid": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:07:8e,bridge_name='br-int',has_traffic_filtering=True,id=ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9534ad-df') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:07:8e,bridge_name='br-int',has_traffic_filtering=True,id=ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9534ad-df') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped9534ad-df, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:11 user nova-compute[71692]: INFO os_vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:07:8e,bridge_name='br-int',has_traffic_filtering=True,id=ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped9534ad-df')
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:06:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "address": "fa:16:3e:44:c2:9d", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0eb0dff-32", "ovs_interfaceid": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "address": "fa:16:3e:44:c2:9d", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0eb0dff-32", "ovs_interfaceid": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:c2:9d,bridge_name='br-int',has_traffic_filtering=True,id=e0eb0dff-32a5-4b83-a302-b1293d0effdc,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0eb0dff-32') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c2:9d,bridge_name='br-int',has_traffic_filtering=True,id=e0eb0dff-32a5-4b83-a302-b1293d0effdc,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0eb0dff-32') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0eb0dff-32, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:11 user nova-compute[71692]: INFO os_vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c2:9d,bridge_name='br-int',has_traffic_filtering=True,id=e0eb0dff-32a5-4b83-a302-b1293d0effdc,network=Network(99dd60fd-7619-4a54-aaa4-c8e0ab450889),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0eb0dff-32')
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:06:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be95859a-0075-4a7d-b4f3-c89c61e54984", "address": "fa:16:3e:1a:a0:c1", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe95859a-00", "ovs_interfaceid": "be95859a-0075-4a7d-b4f3-c89c61e54984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "be95859a-0075-4a7d-b4f3-c89c61e54984", "address": "fa:16:3e:1a:a0:c1", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe95859a-00", "ovs_interfaceid": "be95859a-0075-4a7d-b4f3-c89c61e54984", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:a0:c1,bridge_name='br-int',has_traffic_filtering=True,id=be95859a-0075-4a7d-b4f3-c89c61e54984,network=Network(1dfc8e0b-1385-4707-af71-f2b785cb8ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe95859a-00') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:a0:c1,bridge_name='br-int',has_traffic_filtering=True,id=be95859a-0075-4a7d-b4f3-c89c61e54984,network=Network(1dfc8e0b-1385-4707-af71-f2b785cb8ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe95859a-00') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe95859a-00, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:11 user nova-compute[71692]: INFO os_vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:a0:c1,bridge_name='br-int',has_traffic_filtering=True,id=be95859a-0075-4a7d-b4f3-c89c61e54984,network=Network(1dfc8e0b-1385-4707-af71-f2b785cb8ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe95859a-00')
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T19:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1531978506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1531978506',id=18,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/OUC9IrHY/Vaytj4fbgfVB1BMe8qZ5bxcPqIQEpNw0mjtZ2M8iLoNfzvVqGDiV4j01y0/JfbXqQJj8yTmOtjRIxSGy3vw4FxRqEVwWlXLesNc5riV0al2L/89xVKf5gg==',key_name='tempest-keypair-1586634884',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:06:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d8f6086043e47289bafbe341f3379d5',ramdisk_id='',reservation_id='r-9hf08zqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-801682052',owner_user_name='tempest-TaggedBootDevicesTest-801682052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:06:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8649dbc1659844ef9b98ae022beda26a',uuid=4e2d4287-0adb-4045-b6e8-25095b5d3bbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d35454b-179a-4fcc-a56d-445475aa2900", "address": "fa:16:3e:54:0a:10", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d35454b-17", "ovs_interfaceid": "5d35454b-179a-4fcc-a56d-445475aa2900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converting VIF {"id": "5d35454b-179a-4fcc-a56d-445475aa2900", "address": "fa:16:3e:54:0a:10", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d35454b-17", "ovs_interfaceid": "5d35454b-179a-4fcc-a56d-445475aa2900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=5d35454b-179a-4fcc-a56d-445475aa2900,network=Network(1dfc8e0b-1385-4707-af71-f2b785cb8ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d35454b-17') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=5d35454b-179a-4fcc-a56d-445475aa2900,network=Network(1dfc8e0b-1385-4707-af71-f2b785cb8ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d35454b-17') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d35454b-17, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:08:11 user nova-compute[71692]: INFO os_vif [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:0a:10,bridge_name='br-int',has_traffic_filtering=True,id=5d35454b-179a-4fcc-a56d-445475aa2900,network=Network(1dfc8e0b-1385-4707-af71-f2b785cb8ff7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d35454b-17')
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQVBZERi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:08:11 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[021ceb6c-eb3a-4996-9d54-5ba615e18429]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:08:11 user nova-compute[71692]: No targets found.
Apr 13 19:08:11 user nova-compute[71692]: iSNS:
Apr 13 19:08:11 user nova-compute[71692]: No targets found.
Apr 13 19:08:11 user nova-compute[71692]: STATIC:
Apr 13 19:08:11 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b
Apr 13 19:08:11 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:08:11 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:08:11 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414
Apr 13 19:08:11 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:08:11 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:08:11 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7
Apr 13 19:08:11 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:08:11 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:08:11 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96
Apr 13 19:08:11 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:08:11 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:08:11 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407
Apr 13 19:08:11 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:08:11 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:08:11 user nova-compute[71692]: FIRMWARE:
Apr 13 19:08:11 user nova-compute[71692]: No targets found.
Apr 13 19:08:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:08:11 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:08:11 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d563de6-7cf2-49af-a06a-e492514ed022]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b5da3d-3c61-4551-82c1-6999121835c4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:08:11 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:08:11 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:08:11 user nova-compute[71692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:08:11 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:08:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b (non-flash)
Apr 13 19:08:11 user nova-compute[71692]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:08:11 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:08:11 user nova-compute[71692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:08:11 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:08:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febd8c8cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b'): ({'sdc'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Removing single pathed devices sdc {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fc10e0-78a6-4177-b651-5a553f8831f8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d293efb0-8ec5-47d9-9951-2e1cb51833e8]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Flushing IO for device /dev/sdc {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[769ba258-3362-4157-91a6-6d133addcf8c]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f049e8f2-a0a1-4012-b12d-35d839dfb89a]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[01393b2a-ff82-4032-b3c7-ce12710d31f5]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-28b89f9c-8af3-4c33-89a9-55c61aaafe03 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-28b89f9c-8af3-4c33-89a9-55c61aaafe03 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:11 user nova-compute[71692]: WARNING nova.compute.manager [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-28b89f9c-8af3-4c33-89a9-55c61aaafe03 for instance with vm_state active and task_state deleting.
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-unplugged-5d35454b-179a-4fcc-a56d-445475aa2900 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-unplugged-5d35454b-179a-4fcc-a56d-445475aa2900 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-unplugged-5d35454b-179a-4fcc-a56d-445475aa2900 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-5d35454b-179a-4fcc-a56d-445475aa2900 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-5d35454b-179a-4fcc-a56d-445475aa2900 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:11 user nova-compute[71692]: WARNING nova.compute.manager [req-0871c3aa-9ec7-4186-b35a-07e5b8372cda req-bb3a17f6-21e3-41fa-9d43-064f01a816a4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-5d35454b-179a-4fcc-a56d-445475aa2900 for instance with vm_state active and task_state deleting.
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d8c63d-6039-427d-9c41-551c401dfbab]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b, portal: 172.16.0.220,3260]
Apr 13 19:08:11 user nova-compute[71692]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b, portal: 172.16.0.220,3260] successful.
Apr 13 19:08:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e14c389-bd5a-4d04-aa08-2c6733b87b8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f012a472-73af-4ecf-97a2-06a40b0eb398]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] <== disconnect_volume: return (327ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krjIcgPe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:08:11 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:11 user nova-compute[71692]: WARNING nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-1ea157b6-07a2-4ff3-b11f-b7ea88de6e12 for instance with vm_state active and task_state deleting.
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-unplugged-d4f7e511-017c-4a16-8e0c-21f468f87027 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-unplugged-d4f7e511-017c-4a16-8e0c-21f468f87027 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-unplugged-d4f7e511-017c-4a16-8e0c-21f468f87027 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-d4f7e511-017c-4a16-8e0c-21f468f87027 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-d4f7e511-017c-4a16-8e0c-21f468f87027 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:11 user nova-compute[71692]: WARNING nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-d4f7e511-017c-4a16-8e0c-21f468f87027 for instance with vm_state active and task_state deleting.
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-unplugged-ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-unplugged-ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-unplugged-ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:11 user nova-compute[71692]: WARNING nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 for instance with vm_state active and task_state deleting.
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-unplugged-e0eb0dff-32a5-4b83-a302-b1293d0effdc {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-unplugged-e0eb0dff-32a5-4b83-a302-b1293d0effdc {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-unplugged-e0eb0dff-32a5-4b83-a302-b1293d0effdc for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-e0eb0dff-32a5-4b83-a302-b1293d0effdc {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-e0eb0dff-32a5-4b83-a302-b1293d0effdc {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:11 user nova-compute[71692]: WARNING nova.compute.manager [req-5008755d-64e3-4407-a851-cd2dffc6a696 req-6602f3de-15f0-483e-b956-8cf22e29d2d4 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-e0eb0dff-32a5-4b83-a302-b1293d0effdc for instance with vm_state active and task_state deleting.
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3145be2e-61b6-44ab-a6cc-2af12cf6b40a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:08:11 user nova-compute[71692]: No targets found.
Apr 13 19:08:11 user nova-compute[71692]: iSNS:
Apr 13 19:08:11 user nova-compute[71692]: No targets found.
Apr 13 19:08:11 user nova-compute[71692]: STATIC:
Apr 13 19:08:11 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414
Apr 13 19:08:11 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:08:11 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:08:11 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7
Apr 13 19:08:11 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:08:11 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:08:11 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96
Apr 13 19:08:11 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:08:11 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:08:11 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407
Apr 13 19:08:11 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:08:11 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:08:11 user nova-compute[71692]: FIRMWARE:
Apr 13 19:08:11 user nova-compute[71692]: No targets found.
Apr 13 19:08:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:08:11 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:08:11 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[75157bed-0c57-47a6-833f-fa09b32bbc61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9b8ba9-7396-4159-8a71-c6a6a154d682]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:08:11 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:08:11 user nova-compute[71692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:08:11 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:08:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 (non-flash)
Apr 13 19:08:11 user nova-compute[71692]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:08:11 user nova-compute[71692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:08:11 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:08:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febc4107b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407'): ({'sdd'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Removing single pathed devices sdd {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfefaede-00f1-4230-8922-9f3f01910931]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afcf5a5-33b5-46fb-998f-4bb19f404af0]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Flushing IO for device /dev/sdd {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d90bde2-5669-42a9-94fb-505123e32856]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[599aea54-001a-45c2-9e90-530aad5ba9d3]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7941213a-f998-41f8-9b34-c283860462f4]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e036681-5a68-462e-bec9-2782c742821a]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407, portal: 172.16.0.220,3260]
Apr 13 19:08:11 user nova-compute[71692]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407, portal: 172.16.0.220,3260] successful.
Apr 13 19:08:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12c42f5e-32d2-4365-b2e4-096988f7b407 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[052ca68d-61b0-4464-b3ad-7687287f8241]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] <== disconnect_volume: return (316ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:08:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hNiTgBpw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:08:12 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bad354-ec04-4f32-b4e9-1b2f90b7db07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:08:12 user nova-compute[71692]: No targets found.
Apr 13 19:08:12 user nova-compute[71692]: iSNS:
Apr 13 19:08:12 user nova-compute[71692]: No targets found.
Apr 13 19:08:12 user nova-compute[71692]: STATIC:
Apr 13 19:08:12 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414
Apr 13 19:08:12 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:08:12 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:08:12 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7
Apr 13 19:08:12 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:08:12 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:08:12 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96
Apr 13 19:08:12 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:08:12 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:08:12 user nova-compute[71692]: FIRMWARE:
Apr 13 19:08:12 user nova-compute[71692]: No targets found.
Apr 13 19:08:12 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:08:12 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:08:12 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fb4060-949e-4c15-9c79-4901aa6fb014]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc73eca1-5f6f-4346-a54f-5133bc901f57]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:08:12 user nova-compute[71692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:08:12 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:08:12 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 (non-flash)
Apr 13 19:08:12 user nova-compute[71692]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:08:12 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:08:12 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc6a1a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7'): ({'sde'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Removing single pathed devices sde {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ab2aff-15a8-4cf5-bd96-fb07884b0a66]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0ba1ad-148d-4b95-a6e8-2d444f0d1fde]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Flushing IO for device /dev/sde {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[96215165-ddf4-4240-87e5-7251455376ef]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[95208861-b7a5-4794-b3af-fda1ca43631a]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] SCSI volumes sde have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bb0b60-d78d-4f4d-8c98-61f617698598]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4338c0a4-037a-46ff-a369-0626fa3223ca]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7, portal: 172.16.0.220,3260]
Apr 13 19:08:12 user nova-compute[71692]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7, portal: 172.16.0.220,3260] successful.
Apr 13 19:08:12 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:304fa834-218d-40d5-a6d1-3b17810e41d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db13348-7328-41d0-b24e-bb46a99ad3a7]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] <== disconnect_volume: return (273ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:08:12 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Deleting instance files /opt/stack/data/nova/instances/4e2d4287-0adb-4045-b6e8-25095b5d3bbf_del
Apr 13 19:08:12 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Deletion of /opt/stack/data/nova/instances/4e2d4287-0adb-4045-b6e8-25095b5d3bbf_del complete
Apr 13 19:08:12 user nova-compute[71692]: INFO nova.compute.manager [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Took 3.12 seconds to destroy the instance on the hypervisor.
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-a153dab4-e16c-49c6-aef8-2cb7bd4d9c2f req-7121958b-9b06-48ca-ba5b-ec0c51cd7950 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-plugged-be95859a-0075-4a7d-b4f3-c89c61e54984 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a153dab4-e16c-49c6-aef8-2cb7bd4d9c2f req-7121958b-9b06-48ca-ba5b-ec0c51cd7950 service nova] Acquiring lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a153dab4-e16c-49c6-aef8-2cb7bd4d9c2f req-7121958b-9b06-48ca-ba5b-ec0c51cd7950 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a153dab4-e16c-49c6-aef8-2cb7bd4d9c2f req-7121958b-9b06-48ca-ba5b-ec0c51cd7950 service nova] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-a153dab4-e16c-49c6-aef8-2cb7bd4d9c2f req-7121958b-9b06-48ca-ba5b-ec0c51cd7950 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] No waiting events found dispatching network-vif-plugged-be95859a-0075-4a7d-b4f3-c89c61e54984 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:12 user nova-compute[71692]: WARNING nova.compute.manager [req-a153dab4-e16c-49c6-aef8-2cb7bd4d9c2f req-7121958b-9b06-48ca-ba5b-ec0c51cd7950 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received unexpected event network-vif-plugged-be95859a-0075-4a7d-b4f3-c89c61e54984 for instance with vm_state active and task_state deleting.
Apr 13 19:08:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-e39f8d8e-71cf-4d07-92de-96365b783da3 req-0743d847-faf0-4105-a8bd-d6056b5ece91 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-deleted-be95859a-0075-4a7d-b4f3-c89c61e54984 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:14 user nova-compute[71692]: INFO nova.compute.manager [req-e39f8d8e-71cf-4d07-92de-96365b783da3 req-0743d847-faf0-4105-a8bd-d6056b5ece91 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Neutron deleted interface be95859a-0075-4a7d-b4f3-c89c61e54984; detaching it from the instance and deleting it from the info cache
Apr 13 19:08:14 user nova-compute[71692]: DEBUG nova.network.neutron [req-e39f8d8e-71cf-4d07-92de-96365b783da3 req-0743d847-faf0-4105-a8bd-d6056b5ece91 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updating instance_info_cache with network_info: [{"id": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "address": "fa:16:3e:5f:cd:f6", "network": {"id": "63a9c9d2-0f2a-4643-b048-dcf2389044cc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1932742453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28b89f9c-8a", "ovs_interfaceid": "28b89f9c-8af3-4c33-89a9-55c61aaafe03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "address": "fa:16:3e:07:f8:b3", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea157b6-07", "ovs_interfaceid": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4f7e511-017c-4a16-8e0c-21f468f87027", "address": "fa:16:3e:4c:50:43", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7e511-01", "ovs_interfaceid": "d4f7e511-017c-4a16-8e0c-21f468f87027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "address": "fa:16:3e:49:07:8e", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9534ad-df", "ovs_interfaceid": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "address": "fa:16:3e:44:c2:9d", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0eb0dff-32", "ovs_interfaceid": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d35454b-179a-4fcc-a56d-445475aa2900", "address": "fa:16:3e:54:0a:10", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d35454b-17", "ovs_interfaceid": "5d35454b-179a-4fcc-a56d-445475aa2900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:08:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-e39f8d8e-71cf-4d07-92de-96365b783da3 req-0743d847-faf0-4105-a8bd-d6056b5ece91 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Detach interface failed, port_id=be95859a-0075-4a7d-b4f3-c89c61e54984, reason: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. {{(pid=71692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 19:08:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-deleted-28b89f9c-8af3-4c33-89a9-55c61aaafe03 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:16 user nova-compute[71692]: INFO nova.compute.manager [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Neutron deleted interface 28b89f9c-8af3-4c33-89a9-55c61aaafe03; detaching it from the instance and deleting it from the info cache
Apr 13 19:08:16 user nova-compute[71692]: DEBUG nova.network.neutron [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updating instance_info_cache with network_info: [{"id": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "address": "fa:16:3e:07:f8:b3", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea157b6-07", "ovs_interfaceid": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4f7e511-017c-4a16-8e0c-21f468f87027", "address": "fa:16:3e:4c:50:43", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7e511-01", "ovs_interfaceid": "d4f7e511-017c-4a16-8e0c-21f468f87027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "address": "fa:16:3e:49:07:8e", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9534ad-df", "ovs_interfaceid": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "address": "fa:16:3e:44:c2:9d", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0eb0dff-32", "ovs_interfaceid": "e0eb0dff-32a5-4b83-a302-b1293d0effdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d35454b-179a-4fcc-a56d-445475aa2900", "address": "fa:16:3e:54:0a:10", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d35454b-17", "ovs_interfaceid": "5d35454b-179a-4fcc-a56d-445475aa2900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:08:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Detach interface failed, port_id=28b89f9c-8af3-4c33-89a9-55c61aaafe03, reason: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. {{(pid=71692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 19:08:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-deleted-e0eb0dff-32a5-4b83-a302-b1293d0effdc {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:16 user nova-compute[71692]: INFO nova.compute.manager [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Neutron deleted interface e0eb0dff-32a5-4b83-a302-b1293d0effdc; detaching it from the instance and deleting it from the info cache
Apr 13 19:08:16 user nova-compute[71692]: DEBUG nova.network.neutron [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updating instance_info_cache with network_info: [{"id": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "address": "fa:16:3e:07:f8:b3", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea157b6-07", "ovs_interfaceid": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4f7e511-017c-4a16-8e0c-21f468f87027", "address": "fa:16:3e:4c:50:43", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7e511-01", "ovs_interfaceid": "d4f7e511-017c-4a16-8e0c-21f468f87027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "address": "fa:16:3e:49:07:8e", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped9534ad-df", "ovs_interfaceid": "ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5d35454b-179a-4fcc-a56d-445475aa2900", "address": "fa:16:3e:54:0a:10", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d35454b-17", "ovs_interfaceid": "5d35454b-179a-4fcc-a56d-445475aa2900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:08:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Detach interface failed, port_id=e0eb0dff-32a5-4b83-a302-b1293d0effdc, reason: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. {{(pid=71692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 19:08:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-deleted-ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:16 user nova-compute[71692]: INFO nova.compute.manager [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Neutron deleted interface ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22; detaching it from the instance and deleting it from the info cache
Apr 13 19:08:16 user nova-compute[71692]: DEBUG nova.network.neutron [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updating instance_info_cache with network_info: [{"id": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "address": "fa:16:3e:07:f8:b3", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ea157b6-07", "ovs_interfaceid": "1ea157b6-07a2-4ff3-b11f-b7ea88de6e12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d4f7e511-017c-4a16-8e0c-21f468f87027", "address": "fa:16:3e:4c:50:43", "network": {"id": "99dd60fd-7619-4a54-aaa4-c8e0ab450889", "bridge": "br-int", "label": "tempest-device-tagging-net1-951309907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f7e511-01", "ovs_interfaceid": "d4f7e511-017c-4a16-8e0c-21f468f87027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5d35454b-179a-4fcc-a56d-445475aa2900", "address": "fa:16:3e:54:0a:10", "network": {"id": "1dfc8e0b-1385-4707-af71-f2b785cb8ff7", "bridge": "br-int", "label": "tempest-device-tagging-net2-2052604545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2d8f6086043e47289bafbe341f3379d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d35454b-17", "ovs_interfaceid": "5d35454b-179a-4fcc-a56d-445475aa2900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:08:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-9b903dca-d1b3-41bd-bee0-e5ebf99ba2ac req-52e454e5-4ac2-408c-b987-176a0cd18bc3 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Detach interface failed, port_id=ed9534ad-dfb5-4bb2-b11b-ac8d8d149a22, reason: Instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf could not be found. {{(pid=71692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 19:08:16 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:08:16 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Took 3.92 seconds to deallocate network for instance.
Apr 13 19:08:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:18 user nova-compute[71692]: DEBUG nova.compute.manager [req-297e3ffa-118f-4e20-82fb-48eb6acb8f7e req-9845599a-7a45-47e6-8bc2-b8931f68f993 service nova] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Received event network-vif-deleted-5d35454b-179a-4fcc-a56d-445475aa2900 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:18 user nova-compute[71692]: INFO nova.compute.manager [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Took 2.38 seconds to detach 3 volumes for instance.
Apr 13 19:08:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:18 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:08:18 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:08:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:19 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Deleted allocations for instance 4e2d4287-0adb-4045-b6e8-25095b5d3bbf
Apr 13 19:08:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d9992df0-c4cb-4da9-8558-b733a5da1ff8 tempest-TaggedBootDevicesTest-801682052 tempest-TaggedBootDevicesTest-801682052-project-member] Lock "4e2d4287-0adb-4045-b6e8-25095b5d3bbf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.926s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:25 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412890.9673524, 4e2d4287-0adb-4045-b6e8-25095b5d3bbf => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:08:25 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] VM Stopped (Lifecycle Event)
Apr 13 19:08:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-4a41b9c2-2f9a-4d5a-af1d-bc1928c5ed45 None None] [instance: 4e2d4287-0adb-4045-b6e8-25095b5d3bbf] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:08:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:08:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:08:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:08:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:08:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:34 user nova-compute[71692]: INFO nova.compute.manager [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Rescuing
Apr 13 19:08:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:08:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquired lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:08:34 user nova-compute[71692]: DEBUG nova.network.neutron [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG nova.network.neutron [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Updating instance_info_cache with network_info: [{"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Releasing lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG nova.compute.manager [req-b84772c1-2a4e-4997-95c3-435737324915 req-11456fe2-ee50-4a87-be4c-ba1dcff512bc service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received event network-vif-unplugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b84772c1-2a4e-4997-95c3-435737324915 req-11456fe2-ee50-4a87-be4c-ba1dcff512bc service nova] Acquiring lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b84772c1-2a4e-4997-95c3-435737324915 req-11456fe2-ee50-4a87-be4c-ba1dcff512bc service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b84772c1-2a4e-4997-95c3-435737324915 req-11456fe2-ee50-4a87-be4c-ba1dcff512bc service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG nova.compute.manager [req-b84772c1-2a4e-4997-95c3-435737324915 req-11456fe2-ee50-4a87-be4c-ba1dcff512bc service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] No waiting events found dispatching network-vif-unplugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:35 user nova-compute[71692]: WARNING nova.compute.manager [req-b84772c1-2a4e-4997-95c3-435737324915 req-11456fe2-ee50-4a87-be4c-ba1dcff512bc service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received unexpected event network-vif-unplugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance with vm_state active and task_state rescuing.
Apr 13 19:08:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Instance destroyed successfully.
Apr 13 19:08:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Attempting rescue
Apr 13 19:08:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71692) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Instance directory exists: not creating {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 19:08:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Creating image(s)
Apr 13 19:08:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "/opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "/opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "/opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG nova.objects.instance [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'trusted_certs' on Instance uuid 29eeca99-f237-49d9-9c7d-5c5b7ff2892f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.200s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk.rescue {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk.rescue" returned: 0 in 0.049s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG nova.objects.instance [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'migration_context' on Instance uuid 29eeca99-f237-49d9-9c7d-5c5b7ff2892f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Start _get_guest_xml network_info=[{"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "vif_mac": "fa:16:3e:d1:ae:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG nova.objects.instance [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'resources' on Instance uuid 29eeca99-f237-49d9-9c7d-5c5b7ff2892f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:08:35 user nova-compute[71692]: DEBUG nova.objects.instance [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'numa_topology' on Instance uuid 29eeca99-f237-49d9-9c7d-5c5b7ff2892f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:08:36 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:08:36 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.objects.instance [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'vcpu_model' on Instance uuid 29eeca99-f237-49d9-9c7d-5c5b7ff2892f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:03:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-644483843',display_name='tempest-ServerRescueNegativeTestJSON-server-644483843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-644483843',id=14,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:03:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42fbd7089a7e4ba8b2597fca0d8e84c8',ramdisk_id='',reservation_id='r-n2ktk0pw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1255770111',owner_user_name='tempest-ServerRescueNegativeTestJSON-1255770111-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:04:00Z,user_data=None,user_id='3bebf61a7401492692f9c60adde178f7',uuid=29eeca99-f237-49d9-9c7d-5c5b7ff2892f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "vif_mac": "fa:16:3e:d1:ae:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converting VIF {"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "vif_mac": "fa:16:3e:d1:ae:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:ae:15,bridge_name='br-int',has_traffic_filtering=True,id=0e8742b4-c86f-4294-9d67-8756f74a5b81,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8742b4-c8') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.objects.instance [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'pci_devices' on Instance uuid 29eeca99-f237-49d9-9c7d-5c5b7ff2892f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:08:36 user nova-compute[71692]:   <uuid>29eeca99-f237-49d9-9c7d-5c5b7ff2892f</uuid>
Apr 13 19:08:36 user nova-compute[71692]:   <name>instance-0000000e</name>
Apr 13 19:08:36 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:08:36 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:08:36 user nova-compute[71692]:   <metadata>
Apr 13 19:08:36 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:08:36 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:08:36 user nova-compute[71692]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-644483843</nova:name>
Apr 13 19:08:36 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:08:36</nova:creationTime>
Apr 13 19:08:36 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:08:36 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:08:36 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:08:36 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:08:36 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:08:36 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:08:36 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:08:36 user nova-compute[71692]:       <nova:owner>
Apr 13 19:08:36 user nova-compute[71692]:         <nova:user uuid="3bebf61a7401492692f9c60adde178f7">tempest-ServerRescueNegativeTestJSON-1255770111-project-member</nova:user>
Apr 13 19:08:36 user nova-compute[71692]:         <nova:project uuid="42fbd7089a7e4ba8b2597fca0d8e84c8">tempest-ServerRescueNegativeTestJSON-1255770111</nova:project>
Apr 13 19:08:36 user nova-compute[71692]:       </nova:owner>
Apr 13 19:08:36 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:08:36 user nova-compute[71692]:       <nova:ports>
Apr 13 19:08:36 user nova-compute[71692]:         <nova:port uuid="0e8742b4-c86f-4294-9d67-8756f74a5b81">
Apr 13 19:08:36 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 19:08:36 user nova-compute[71692]:         </nova:port>
Apr 13 19:08:36 user nova-compute[71692]:       </nova:ports>
Apr 13 19:08:36 user nova-compute[71692]:     </nova:instance>
Apr 13 19:08:36 user nova-compute[71692]:   </metadata>
Apr 13 19:08:36 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:08:36 user nova-compute[71692]:     <system>
Apr 13 19:08:36 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:08:36 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:08:36 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:08:36 user nova-compute[71692]:       <entry name="serial">29eeca99-f237-49d9-9c7d-5c5b7ff2892f</entry>
Apr 13 19:08:36 user nova-compute[71692]:       <entry name="uuid">29eeca99-f237-49d9-9c7d-5c5b7ff2892f</entry>
Apr 13 19:08:36 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:08:36 user nova-compute[71692]:     </system>
Apr 13 19:08:36 user nova-compute[71692]:   </sysinfo>
Apr 13 19:08:36 user nova-compute[71692]:   <os>
Apr 13 19:08:36 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:08:36 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:08:36 user nova-compute[71692]:   </os>
Apr 13 19:08:36 user nova-compute[71692]:   <features>
Apr 13 19:08:36 user nova-compute[71692]:     <acpi/>
Apr 13 19:08:36 user nova-compute[71692]:     <apic/>
Apr 13 19:08:36 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:08:36 user nova-compute[71692]:   </features>
Apr 13 19:08:36 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:08:36 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:08:36 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:08:36 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:08:36 user nova-compute[71692]:   </clock>
Apr 13 19:08:36 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:08:36 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:08:36 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:08:36 user nova-compute[71692]:   </cpu>
Apr 13 19:08:36 user nova-compute[71692]:   <devices>
Apr 13 19:08:36 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:08:36 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:08:36 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk.rescue"/>
Apr 13 19:08:36 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:08:36 user nova-compute[71692]:     </disk>
Apr 13 19:08:36 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:08:36 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:08:36 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk"/>
Apr 13 19:08:36 user nova-compute[71692]:       <target dev="vdb" bus="virtio"/>
Apr 13 19:08:36 user nova-compute[71692]:     </disk>
Apr 13 19:08:36 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:08:36 user nova-compute[71692]:       <mac address="fa:16:3e:d1:ae:15"/>
Apr 13 19:08:36 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:08:36 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:08:36 user nova-compute[71692]:       <target dev="tap0e8742b4-c8"/>
Apr 13 19:08:36 user nova-compute[71692]:     </interface>
Apr 13 19:08:36 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:08:36 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/console.log" append="off"/>
Apr 13 19:08:36 user nova-compute[71692]:     </serial>
Apr 13 19:08:36 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:08:36 user nova-compute[71692]:     <video>
Apr 13 19:08:36 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:08:36 user nova-compute[71692]:     </video>
Apr 13 19:08:36 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:08:36 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:08:36 user nova-compute[71692]:     </rng>
Apr 13 19:08:36 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:08:36 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:08:36 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:08:36 user nova-compute[71692]:     </memballoon>
Apr 13 19:08:36 user nova-compute[71692]:   </devices>
Apr 13 19:08:36 user nova-compute[71692]: </domain>
Apr 13 19:08:36 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:08:36 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Instance destroyed successfully.
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No VIF found with MAC fa:16:3e:d1:ae:15, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:37 user nova-compute[71692]: DEBUG nova.compute.manager [req-8e5a00f2-355c-4276-9e4c-ec2affd4e5f9 req-faf83c89-71d0-4750-8ac1-bf22da5d0ce1 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8e5a00f2-355c-4276-9e4c-ec2affd4e5f9 req-faf83c89-71d0-4750-8ac1-bf22da5d0ce1 service nova] Acquiring lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8e5a00f2-355c-4276-9e4c-ec2affd4e5f9 req-faf83c89-71d0-4750-8ac1-bf22da5d0ce1 service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8e5a00f2-355c-4276-9e4c-ec2affd4e5f9 req-faf83c89-71d0-4750-8ac1-bf22da5d0ce1 service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:37 user nova-compute[71692]: DEBUG nova.compute.manager [req-8e5a00f2-355c-4276-9e4c-ec2affd4e5f9 req-faf83c89-71d0-4750-8ac1-bf22da5d0ce1 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] No waiting events found dispatching network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:37 user nova-compute[71692]: WARNING nova.compute.manager [req-8e5a00f2-355c-4276-9e4c-ec2affd4e5f9 req-faf83c89-71d0-4750-8ac1-bf22da5d0ce1 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received unexpected event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance with vm_state active and task_state rescuing.
Apr 13 19:08:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:08:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:08:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:08:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:08:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:08:38 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Updating instance_info_cache with network_info: [{"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] Acquiring lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] No waiting events found dispatching network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:39 user nova-compute[71692]: WARNING nova.compute.manager [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received unexpected event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance with vm_state active and task_state rescuing.
Apr 13 19:08:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] Acquiring lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] No waiting events found dispatching network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:08:39 user nova-compute[71692]: WARNING nova.compute.manager [req-990eca70-0040-4195-b2f9-1996eb9034be req-e852fcf0-6ffb-437f-b75b-e8644e5dec6c service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received unexpected event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance with vm_state active and task_state rescuing.
Apr 13 19:08:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Removed pending event for 29eeca99-f237-49d9-9c7d-5c5b7ff2892f due to event {{(pid=71692) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412919.5659394, 29eeca99-f237-49d9-9c7d-5c5b7ff2892f => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:08:39 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] VM Resumed (Lifecycle Event)
Apr 13 19:08:39 user nova-compute[71692]: DEBUG nova.compute.manager [None req-53431da2-14ec-4b98-a702-b98e3fa51fab tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:08:39 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 19:08:39 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412919.5681238, 29eeca99-f237-49d9-9c7d-5c5b7ff2892f => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:08:39 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] VM Started (Lifecycle Event)
Apr 13 19:08:39 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:08:39 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:08:40 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:08:40 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:08:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:40 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:08:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:08:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:08:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:43 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:08:43 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:08:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=7915MB free_disk=26.11589813232422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:08:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:08:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 59d7b86a-c723-4255-827e-2f6a641239df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:08:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance cb3fb753-ff8d-4dac-ab70-f940233bf25d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:08:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:08:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:08:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:08:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 32751522-5725-4cb4-a8bd-234dfe84780b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:08:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:08:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:08:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:08:43 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:08:43 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:08:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:08:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.400s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:44 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:08:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-0eba7e2b-7a02-4b0e-87f7-278d024a286d req-c595c5ee-06d6-4fd2-b855-f08375f1d0ed service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Received event network-changed-3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:08:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-0eba7e2b-7a02-4b0e-87f7-278d024a286d req-c595c5ee-06d6-4fd2-b855-f08375f1d0ed service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Refreshing instance network info cache due to event network-changed-3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:08:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0eba7e2b-7a02-4b0e-87f7-278d024a286d req-c595c5ee-06d6-4fd2-b855-f08375f1d0ed service nova] Acquiring lock "refresh_cache-ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:08:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0eba7e2b-7a02-4b0e-87f7-278d024a286d req-c595c5ee-06d6-4fd2-b855-f08375f1d0ed service nova] Acquired lock "refresh_cache-ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:08:47 user nova-compute[71692]: DEBUG nova.network.neutron [req-0eba7e2b-7a02-4b0e-87f7-278d024a286d req-c595c5ee-06d6-4fd2-b855-f08375f1d0ed service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Refreshing network info cache for port 3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:08:48 user nova-compute[71692]: DEBUG nova.network.neutron [req-0eba7e2b-7a02-4b0e-87f7-278d024a286d req-c595c5ee-06d6-4fd2-b855-f08375f1d0ed service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Updated VIF entry in instance network info cache for port 3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:08:48 user nova-compute[71692]: DEBUG nova.network.neutron [req-0eba7e2b-7a02-4b0e-87f7-278d024a286d req-c595c5ee-06d6-4fd2-b855-f08375f1d0ed service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Updating instance_info_cache with network_info: [{"id": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "address": "fa:16:3e:a2:8d:49", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4cf848-65", "ovs_interfaceid": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:08:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0eba7e2b-7a02-4b0e-87f7-278d024a286d req-c595c5ee-06d6-4fd2-b855-f08375f1d0ed service nova] Releasing lock "refresh_cache-ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG nova.objects.instance [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'flavor' on Instance uuid ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:49 user nova-compute[71692]: INFO nova.compute.manager [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Attaching volume 2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c to /dev/vdb
Apr 13 19:08:49 user nova-compute[71692]: DEBUG os_brick.utils [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[78678081-dc7c-4099-b890-9c8927866142]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cf9a0e-3c55-4f9b-ba45-f235be546ef3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c480cae0-36ec-4b1c-97c5-84272d8d660a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8870c6-45e9-41f2-b72d-0cc3c7d4ba14]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:08:49 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:08:49 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84e76e0-17d8-45c0-bccb-6aa643763d9d]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG os_brick.utils [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:08:49 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Updating existing volume attachment record: 3fcf2480-33b2-42c8-a136-07da8345e070 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:08:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MARFwSHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:08:54 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:08:54 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:08:54 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c81872c-95bd-4761-85da-d88f363eb9e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:08:54 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[06538e81-4894-4cc4-b960-056a13f878fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c] added
Apr 13 19:08:54 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f037b17-7abb-41f5-891c-46949a01c15a]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc39fbde-77f8-4d09-b481-63d13dd02d19]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MARFwSHC {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MARFwSHC" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d613fe-35e5-4c77-814b-73f555b06165]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MARFwSHC'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ba79ae-4c1b-499f-bbf2-6cd06fcee7a9]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc2e5db-eb6f-4713-ae88-7b2870d3937f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:08:54 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:08:54 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:08:54 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:08:54 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b18826e-a65d-46f0-9bcf-8aff2e1408c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c, portal: 172.16.0.220,3260]
Apr 13 19:08:54 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c, portal: 172.16.0.220,3260] successful.
Apr 13 19:08:54 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f0661a-dbb9-48bc-bd5f-220061448a21]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b854261-e4fe-4894-9247-27384b025571]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:08:54 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:08:54 user nova-compute[71692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c (non-flash)
Apr 13 19:08:54 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:08:54 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:08:54 user nova-compute[71692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c (non-flash)
Apr 13 19:08:54 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5025400c-36b4-477c-9897-a3efd35168d7]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:08:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MARFwSHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:08:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:08:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23565346534646335', 'path': '/dev/sdc'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:08:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565346534646335', 'path': '/dev/sdc'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:08:55 user nova-compute[71692]: DEBUG nova.objects.instance [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'flavor' on Instance uuid ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:08:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:08:55 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:08:55 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:08:55 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:08:55 user nova-compute[71692]:   <serial>2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c</serial>
Apr 13 19:08:55 user nova-compute[71692]: </disk>
Apr 13 19:08:55 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:08:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:08:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:08:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] No VIF found with MAC fa:16:3e:a2:8d:49, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:08:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cf383112-750e-469f-8441-766daa7d93f6 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.394s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG nova.objects.instance [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'flavor' on Instance uuid ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:08:58 user nova-compute[71692]: INFO nova.compute.manager [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Attaching volume 9d6086c1-70cc-4b38-a30b-fd1f584bb221 to /dev/vdc
Apr 13 19:08:58 user nova-compute[71692]: DEBUG os_brick.utils [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8aa269d-f0d2-4621-8c38-45e37ac8aa82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb49f96-ae70-42f5-900c-9cf87b476c40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[325c5128-7664-4186-aaac-77f0a007a048]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9d2c0c-2db9-4932-a5e0-f90a8fca2d68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:08:58 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:08:58 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bfd107-f86d-444f-8c4f-25a764bf12c2]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG os_brick.utils [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:08:58 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Updating existing volume attachment record: c1019745-cffd-4dc4-81f0-a8e86699aa26 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:08:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:09:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDMcjQJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:09:02 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:09:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:09:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:09:02 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:09:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:09:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:09:02 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:09:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a4248a-c0c7-4444-b842-fbdf3222d411]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:09:02 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[39346bfa-1109-4531-a601-774d2f26d4f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221] added
Apr 13 19:09:03 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[43357c82-063e-4423-ad92-b71a8a6ca650]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9b7a28-17f2-48a9-b4ac-36e9514ba22b]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IDMcjQJA {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IDMcjQJA" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee0dfb3-2023-48b5-9dda-65f82d92a8ea]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IDMcjQJA'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfacd58-bb94-415e-85c3-ce7a051e440f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2151bb9e-b669-41c1-b331-e440481e5ff4]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:09:03 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:09:03 user nova-compute[71692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c (non-flash)
Apr 13 19:09:03 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:09:03 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:09:03 user nova-compute[71692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c (non-flash)
Apr 13 19:09:03 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[164a58eb-f332-464a-bcc3-4782bbe14a09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221, portal: 172.16.0.220,3260]
Apr 13 19:09:03 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221, portal: 172.16.0.220,3260] successful.
Apr 13 19:09:03 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebda929-13a3-46b9-b3c3-1581cb66b665]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6640b83-f999-489c-84ef-374f50a1453f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:09:03 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:09:03 user nova-compute[71692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c (non-flash)
Apr 13 19:09:03 user nova-compute[71692]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 (non-flash)
Apr 13 19:09:03 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:09:03 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:09:03 user nova-compute[71692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c (non-flash)
Apr 13 19:09:03 user nova-compute[71692]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 (non-flash)
Apr 13 19:09:03 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceda7dd4-c9a0-4ea9-9089-a6f259e72d4f]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:09:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDMcjQJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:09:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:09:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23264376134383864', 'path': '/dev/sdd'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:09:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264376134383864', 'path': '/dev/sdd'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:09:04 user nova-compute[71692]: DEBUG nova.objects.instance [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'flavor' on Instance uuid ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:09:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:09:04 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:09:04 user nova-compute[71692]:   <source dev="/dev/sdd"/>
Apr 13 19:09:04 user nova-compute[71692]:   <target dev="vdc" bus="virtio"/>
Apr 13 19:09:04 user nova-compute[71692]:   <serial>9d6086c1-70cc-4b38-a30b-fd1f584bb221</serial>
Apr 13 19:09:04 user nova-compute[71692]: </disk>
Apr 13 19:09:04 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:09:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:09:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:09:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:09:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] No VIF found with MAC fa:16:3e:a2:8d:49, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:09:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-93144c8e-d66e-443c-9033-1012ea863369 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.635s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:06 user nova-compute[71692]: INFO nova.compute.manager [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Detaching volume 2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c
Apr 13 19:09:06 user nova-compute[71692]: INFO nova.virt.block_device [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Attempting to driver detach volume 2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c from mountpoint /dev/vdb
Apr 13 19:09:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Attempting to detach device vdb from instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:09:06 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:09:06 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:09:06 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:09:06 user nova-compute[71692]:   <serial>2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c</serial>
Apr 13 19:09:06 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:09:06 user nova-compute[71692]: </disk>
Apr 13 19:09:06 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:09:06 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Successfully detached device vdb from instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 from the persistent domain config.
Apr 13 19:09:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:09:06 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:09:06 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:09:06 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:09:06 user nova-compute[71692]:   <serial>2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c</serial>
Apr 13 19:09:06 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:09:06 user nova-compute[71692]: </disk>
Apr 13 19:09:06 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681412946.8545024, ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:09:06 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Successfully detached device vdb from instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 from the live domain config.
Apr 13 19:09:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MARFwSHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:09:06 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:09:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6331f77c-2cc1-463f-ae29-dccf5703bea2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:09:06 user nova-compute[71692]: No targets found.
Apr 13 19:09:06 user nova-compute[71692]: iSNS:
Apr 13 19:09:06 user nova-compute[71692]: No targets found.
Apr 13 19:09:06 user nova-compute[71692]: STATIC:
Apr 13 19:09:06 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414
Apr 13 19:09:06 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:09:06 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:09:06 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221
Apr 13 19:09:06 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:09:06 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:09:06 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96
Apr 13 19:09:06 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:09:06 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:09:06 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c
Apr 13 19:09:06 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:09:06 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:09:06 user nova-compute[71692]: FIRMWARE:
Apr 13 19:09:06 user nova-compute[71692]: No targets found.
Apr 13 19:09:06 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:09:06 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:09:06 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1984836-3f89-4669-b08a-3e865eef6cdd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a76c8a-4100-4116-a5b6-4c6243f41d5b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:09:06 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:09:06 user nova-compute[71692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c (non-flash)
Apr 13 19:09:06 user nova-compute[71692]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 (non-flash)
Apr 13 19:09:06 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:09:06 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:09:06 user nova-compute[71692]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c (non-flash)
Apr 13 19:09:06 user nova-compute[71692]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 (non-flash)
Apr 13 19:09:06 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc290c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c'): ({'sdc'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Removing single pathed devices sdc {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[14141462-dbe0-44fa-89b1-a919934e3267]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb0892d-94ed-4c01-8444-534b5bb1b2ce]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Flushing IO for device /dev/sdc {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:09:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[341af359-c071-4e9b-918c-ab195b4c3997]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[220b03af-245e-441a-80b0-09d23cb862df]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccd4d84-6fe6-46e0-b561-757a6e698422]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[143bba67-2c0d-4279-8270-1ae50db8d0dd]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c, portal: 172.16.0.220,3260]
Apr 13 19:09:07 user nova-compute[71692]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c, portal: 172.16.0.220,3260] successful.
Apr 13 19:09:07 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c4acbce-b8e8-4b4a-bb2b-0cb3ceafce9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1216cedb-f766-47f1-827b-a781d94ebfec]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] <== disconnect_volume: return (314ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:09:07 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:09:08 user nova-compute[71692]: DEBUG nova.objects.instance [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'flavor' on Instance uuid ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:09:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d9317b7c-5d72-441c-a6b3-3fc8fc0d0d20 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.833s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:08 user nova-compute[71692]: INFO nova.compute.manager [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Detaching volume 9d6086c1-70cc-4b38-a30b-fd1f584bb221
Apr 13 19:09:08 user nova-compute[71692]: INFO nova.virt.block_device [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Attempting to driver detach volume 9d6086c1-70cc-4b38-a30b-fd1f584bb221 from mountpoint /dev/vdc
Apr 13 19:09:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Attempting to detach device vdc from instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:09:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:09:08 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:09:08 user nova-compute[71692]:   <source dev="/dev/sdd"/>
Apr 13 19:09:08 user nova-compute[71692]:   <target dev="vdc" bus="virtio"/>
Apr 13 19:09:08 user nova-compute[71692]:   <serial>9d6086c1-70cc-4b38-a30b-fd1f584bb221</serial>
Apr 13 19:09:08 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 19:09:08 user nova-compute[71692]: </disk>
Apr 13 19:09:08 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:09:08 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Successfully detached device vdc from instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 from the persistent domain config.
Apr 13 19:09:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:09:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:09:08 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:09:08 user nova-compute[71692]:   <source dev="/dev/sdd"/>
Apr 13 19:09:08 user nova-compute[71692]:   <target dev="vdc" bus="virtio"/>
Apr 13 19:09:08 user nova-compute[71692]:   <serial>9d6086c1-70cc-4b38-a30b-fd1f584bb221</serial>
Apr 13 19:09:08 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 19:09:08 user nova-compute[71692]: </disk>
Apr 13 19:09:08 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681412949.3968077, ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:09:09 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Successfully detached device vdc from instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 from the live domain config.
Apr 13 19:09:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IDMcjQJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:09:09 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e25fd7-b72a-4a39-aab5-6dcdabd1571c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:09:09 user nova-compute[71692]: No targets found.
Apr 13 19:09:09 user nova-compute[71692]: iSNS:
Apr 13 19:09:09 user nova-compute[71692]: No targets found.
Apr 13 19:09:09 user nova-compute[71692]: STATIC:
Apr 13 19:09:09 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414
Apr 13 19:09:09 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:09:09 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:09:09 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221
Apr 13 19:09:09 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:09:09 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:09:09 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96
Apr 13 19:09:09 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:09:09 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:09:09 user nova-compute[71692]: FIRMWARE:
Apr 13 19:09:09 user nova-compute[71692]: No targets found.
Apr 13 19:09:09 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:09:09 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:09:09 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[482921d8-8ee4-4b4a-9023-8f9f47a2dbd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20817da-aa47-411b-8d74-e1976ef09a8d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:09:09 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:09:09 user nova-compute[71692]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 (non-flash)
Apr 13 19:09:09 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:09:09 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:09:09 user nova-compute[71692]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 (non-flash)
Apr 13 19:09:09 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc2909d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221'): ({'sdd'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Removing single pathed devices sdd {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3464599c-23c2-42a8-859b-8f87bd2be00e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf05ef1-fce3-458b-98f3-2cfaadb9da76]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Flushing IO for device /dev/sdd {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfbc0de-6e2a-442b-860f-7e8e08acd2db]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2f9e9d-37ab-4e59-888b-1b2844c35808]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbd0361-9a6a-460e-b55a-46216fcb2c9a]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[22aac017-5b51-4fab-9c46-9c52537a5893]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221, portal: 172.16.0.220,3260]
Apr 13 19:09:09 user nova-compute[71692]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221, portal: 172.16.0.220,3260] successful.
Apr 13 19:09:09 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d6086c1-70cc-4b38-a30b-fd1f584bb221 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c21dc3f-c368-4f67-8ca6-f1873b2db398]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] <== disconnect_volume: return (314ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:09:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:09:10 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'flavor' on Instance uuid ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:09:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e7a8919f-959c-4339-8978-aaded5fa543d tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.010s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:11 user nova-compute[71692]: INFO nova.compute.manager [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Terminating instance
Apr 13 19:09:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-6849f610-37b4-4a86-ab50-bc032fb53eaf req-09455815-c0f2-490b-9893-087f37791487 service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Received event network-vif-unplugged-3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6849f610-37b4-4a86-ab50-bc032fb53eaf req-09455815-c0f2-490b-9893-087f37791487 service nova] Acquiring lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6849f610-37b4-4a86-ab50-bc032fb53eaf req-09455815-c0f2-490b-9893-087f37791487 service nova] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6849f610-37b4-4a86-ab50-bc032fb53eaf req-09455815-c0f2-490b-9893-087f37791487 service nova] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-6849f610-37b4-4a86-ab50-bc032fb53eaf req-09455815-c0f2-490b-9893-087f37791487 service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] No waiting events found dispatching network-vif-unplugged-3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:09:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-6849f610-37b4-4a86-ab50-bc032fb53eaf req-09455815-c0f2-490b-9893-087f37791487 service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Received event network-vif-unplugged-3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:09:12 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Instance destroyed successfully.
Apr 13 19:09:12 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lazy-loading 'resources' on Instance uuid ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:09:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:06:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2001415604',display_name='tempest-AttachVolumeTestJSON-server-2001415604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2001415604',id=19,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnAulYdzoZYhDen0j/UCqj9wvgRtkdJxgu6k5FF+pAw+g1tgcVbg4FL5+E0vKMU+LKWfdF1n4kies8ZDkczIIVHchJ2PqA4lsul63LTo5xP60Cne9rA0PuQcqa4PxWVVw==',key_name='tempest-keypair-293682674',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:07:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63b52d6508154a918a13b31712b32796',ramdisk_id='',reservation_id='r-7ije5ap5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-43043273',owner_user_name='tempest-AttachVolumeTestJSON-43043273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:07:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba70f34af8664dc89fd9851d00d5b96d',uuid=ee71fe6c-33cc-45aa-b1b7-2d266fa59b04,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "address": "fa:16:3e:a2:8d:49", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4cf848-65", "ovs_interfaceid": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:09:12 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converting VIF {"id": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "address": "fa:16:3e:a2:8d:49", "network": {"id": "2def9fdd-c85f-497e-b62d-2b5585207128", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1797054724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63b52d6508154a918a13b31712b32796", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4cf848-65", "ovs_interfaceid": "3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:09:12 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:8d:49,bridge_name='br-int',has_traffic_filtering=True,id=3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4cf848-65') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:09:12 user nova-compute[71692]: DEBUG os_vif [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:8d:49,bridge_name='br-int',has_traffic_filtering=True,id=3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4cf848-65') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:09:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e4cf848-65, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:09:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:12 user nova-compute[71692]: INFO os_vif [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:8d:49,bridge_name='br-int',has_traffic_filtering=True,id=3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9,network=Network(2def9fdd-c85f-497e-b62d-2b5585207128),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4cf848-65')
Apr 13 19:09:12 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Deleting instance files /opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04_del
Apr 13 19:09:12 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Deletion of /opt/stack/data/nova/instances/ee71fe6c-33cc-45aa-b1b7-2d266fa59b04_del complete
Apr 13 19:09:12 user nova-compute[71692]: INFO nova.compute.manager [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 13 19:09:12 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:09:12 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:09:12 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:09:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:13 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:09:13 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Took 1.26 seconds to deallocate network for instance.
Apr 13 19:09:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-7e60ede2-89ae-44ca-bee4-a27eaaae874e req-ad2c3932-52dc-492d-adec-90e4d0a84c0a service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Received event network-vif-deleted-3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:09:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:13 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:09:13 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:09:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:13 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Deleted allocations for instance ee71fe6c-33cc-45aa-b1b7-2d266fa59b04
Apr 13 19:09:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecc6a384-7e10-4333-8788-4a59cbd8e811 tempest-AttachVolumeTestJSON-43043273 tempest-AttachVolumeTestJSON-43043273-project-member] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.582s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-c9b3450b-aa71-4c2a-b309-8ff0f1c2405f req-251224e7-fc0c-4f27-a5af-0283dae09998 service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Received event network-vif-plugged-3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:09:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c9b3450b-aa71-4c2a-b309-8ff0f1c2405f req-251224e7-fc0c-4f27-a5af-0283dae09998 service nova] Acquiring lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c9b3450b-aa71-4c2a-b309-8ff0f1c2405f req-251224e7-fc0c-4f27-a5af-0283dae09998 service nova] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c9b3450b-aa71-4c2a-b309-8ff0f1c2405f req-251224e7-fc0c-4f27-a5af-0283dae09998 service nova] Lock "ee71fe6c-33cc-45aa-b1b7-2d266fa59b04-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-c9b3450b-aa71-4c2a-b309-8ff0f1c2405f req-251224e7-fc0c-4f27-a5af-0283dae09998 service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] No waiting events found dispatching network-vif-plugged-3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:09:14 user nova-compute[71692]: WARNING nova.compute.manager [req-c9b3450b-aa71-4c2a-b309-8ff0f1c2405f req-251224e7-fc0c-4f27-a5af-0283dae09998 service nova] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Received unexpected event network-vif-plugged-3e4cf848-65cd-4d6e-9bcd-4bc90f86e1a9 for instance with vm_state deleted and task_state None.
Apr 13 19:09:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:15 user nova-compute[71692]: INFO nova.compute.manager [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Shelve offloading
Apr 13 19:09:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-9703ee79-80a9-41db-9218-bfb32acc40d1 req-db08cc69-045c-4b43-9fc1-98be44b5b5e4 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received event network-vif-unplugged-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:09:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9703ee79-80a9-41db-9218-bfb32acc40d1 req-db08cc69-045c-4b43-9fc1-98be44b5b5e4 service nova] Acquiring lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9703ee79-80a9-41db-9218-bfb32acc40d1 req-db08cc69-045c-4b43-9fc1-98be44b5b5e4 service nova] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9703ee79-80a9-41db-9218-bfb32acc40d1 req-db08cc69-045c-4b43-9fc1-98be44b5b5e4 service nova] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-9703ee79-80a9-41db-9218-bfb32acc40d1 req-db08cc69-045c-4b43-9fc1-98be44b5b5e4 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] No waiting events found dispatching network-vif-unplugged-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:09:15 user nova-compute[71692]: WARNING nova.compute.manager [req-9703ee79-80a9-41db-9218-bfb32acc40d1 req-db08cc69-045c-4b43-9fc1-98be44b5b5e4 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received unexpected event network-vif-unplugged-8640b481-7480-494b-a88b-e21419d695cf for instance with vm_state active and task_state shelving.
Apr 13 19:09:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:15 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Instance destroyed successfully.
Apr 13 19:09:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:09:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:09:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquired lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:09:15 user nova-compute[71692]: DEBUG nova.network.neutron [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:09:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-db96adc8-7d92-4355-8c38-4edf13e13baa req-953fa139-7edd-4380-8ed5-64380d57eaaa service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received event network-changed-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:09:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-db96adc8-7d92-4355-8c38-4edf13e13baa req-953fa139-7edd-4380-8ed5-64380d57eaaa service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Refreshing instance network info cache due to event network-changed-8640b481-7480-494b-a88b-e21419d695cf. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:09:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-db96adc8-7d92-4355-8c38-4edf13e13baa req-953fa139-7edd-4380-8ed5-64380d57eaaa service nova] Acquiring lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:09:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:16 user nova-compute[71692]: DEBUG nova.network.neutron [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updating instance_info_cache with network_info: [{"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:09:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Releasing lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:09:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-db96adc8-7d92-4355-8c38-4edf13e13baa req-953fa139-7edd-4380-8ed5-64380d57eaaa service nova] Acquired lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:09:16 user nova-compute[71692]: DEBUG nova.network.neutron [req-db96adc8-7d92-4355-8c38-4edf13e13baa req-953fa139-7edd-4380-8ed5-64380d57eaaa service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Refreshing network info cache for port 8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:09:17 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Instance destroyed successfully.
Apr 13 19:09:17 user nova-compute[71692]: DEBUG nova.objects.instance [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lazy-loading 'resources' on Instance uuid 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-83408209',display_name='tempest-TestShelveInstance-server-83408209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-83408209',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIq1t/DMvVpTcEEakPI/0JWmf4BthPiZo8lPCqhHBmih4IYVT4syad6jzJ8PVHxlvM4PPItdyY2igXoht4WeZ8Uv1bT9f9eJhSMIlwuyiyywQzUvP/REC4xOo31hpBbNg==',key_name='tempest-TestShelveInstance-24428880',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:07:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20b8fe614f0541009788ffe685720634',ramdisk_id='',reservation_id='r-p03apkpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1512441304',owner_user_name='tempest-TestShelveInstance-1512441304-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:07:34Z,user_data=None,user_id='e44f04fabef14935a4617dd452d3999b',uuid=8c60e6c0-533c-4fd3-938f-b9ecc9fb0333,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Converting VIF {"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e5:46,bridge_name='br-int',has_traffic_filtering=True,id=8640b481-7480-494b-a88b-e21419d695cf,network=Network(caba0c3f-498e-458e-86ba-f7a0a147a7d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8640b481-74') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_vif [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e5:46,bridge_name='br-int',has_traffic_filtering=True,id=8640b481-7480-494b-a88b-e21419d695cf,network=Network(caba0c3f-498e-458e-86ba-f7a0a147a7d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8640b481-74') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG nova.network.neutron [req-db96adc8-7d92-4355-8c38-4edf13e13baa req-953fa139-7edd-4380-8ed5-64380d57eaaa service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updated VIF entry in instance network info cache for port 8640b481-7480-494b-a88b-e21419d695cf. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG nova.network.neutron [req-db96adc8-7d92-4355-8c38-4edf13e13baa req-953fa139-7edd-4380-8ed5-64380d57eaaa service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updating instance_info_cache with network_info: [{"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8640b481-74, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-902093cb-8157-48e9-b077-3de48341cd70 req-7c85ca03-6c66-4352-9fcf-961619823c82 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received event network-changed-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-902093cb-8157-48e9-b077-3de48341cd70 req-7c85ca03-6c66-4352-9fcf-961619823c82 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Refreshing instance network info cache due to event network-changed-8640b481-7480-494b-a88b-e21419d695cf. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-902093cb-8157-48e9-b077-3de48341cd70 req-7c85ca03-6c66-4352-9fcf-961619823c82 service nova] Acquiring lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-db96adc8-7d92-4355-8c38-4edf13e13baa req-953fa139-7edd-4380-8ed5-64380d57eaaa service nova] Releasing lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:09:17 user nova-compute[71692]: INFO os_vif [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e5:46,bridge_name='br-int',has_traffic_filtering=True,id=8640b481-7480-494b-a88b-e21419d695cf,network=Network(caba0c3f-498e-458e-86ba-f7a0a147a7d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8640b481-74')
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-902093cb-8157-48e9-b077-3de48341cd70 req-7c85ca03-6c66-4352-9fcf-961619823c82 service nova] Acquired lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG nova.network.neutron [req-902093cb-8157-48e9-b077-3de48341cd70 req-7c85ca03-6c66-4352-9fcf-961619823c82 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Refreshing network info cache for port 8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NeMxmspT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:09:17 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[af77d408-caac-4cd5-8a68-c8a45ec70803]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:09:17 user nova-compute[71692]: No targets found.
Apr 13 19:09:17 user nova-compute[71692]: iSNS:
Apr 13 19:09:17 user nova-compute[71692]: No targets found.
Apr 13 19:09:17 user nova-compute[71692]: STATIC:
Apr 13 19:09:17 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414
Apr 13 19:09:17 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:09:17 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:09:17 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96
Apr 13 19:09:17 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:09:17 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:09:17 user nova-compute[71692]: FIRMWARE:
Apr 13 19:09:17 user nova-compute[71692]: No targets found.
Apr 13 19:09:17 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:09:17 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:09:17 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7efe3c-02a5-4300-b0c5-ebba793f5028]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4205dc94-9d77-473f-a089-bdbbceb2a8c8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:09:17 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:09:17 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:09:17 user nova-compute[71692]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:09:17 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febd8b5cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96'): ({'sdb'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Removing single pathed devices sdb {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[02111eb5-23d1-465b-9453-c2c0c5d2d3b0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f2953f-0b63-418c-ba5e-10cca92e20ba]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Flushing IO for device /dev/sdb {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a72f77-5f11-4b78-be6a-cfca5dcfa654]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a651a2a9-ea4e-4e29-a631-e41e5a702279]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbadde58-9a27-45cd-990b-6ea0a0a8480b]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7186d84-40ad-41f3-9027-0c31d4622c64]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96, portal: 172.16.0.220,3260]
Apr 13 19:09:17 user nova-compute[71692]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96, portal: 172.16.0.220,3260] successful.
Apr 13 19:09:17 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abaae61-c76a-4267-acc9-66e95a340d75]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] <== disconnect_volume: return (315ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:09:17 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Deleting instance files /opt/stack/data/nova/instances/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333_del
Apr 13 19:09:17 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Deletion of /opt/stack/data/nova/instances/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333_del complete
Apr 13 19:09:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-2a277ac8-5875-4b1e-9628-5556e809eaf6 req-f88be216-ded1-494b-bdc0-0060fee37159 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received event network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2a277ac8-5875-4b1e-9628-5556e809eaf6 req-f88be216-ded1-494b-bdc0-0060fee37159 service nova] Acquiring lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2a277ac8-5875-4b1e-9628-5556e809eaf6 req-f88be216-ded1-494b-bdc0-0060fee37159 service nova] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2a277ac8-5875-4b1e-9628-5556e809eaf6 req-f88be216-ded1-494b-bdc0-0060fee37159 service nova] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-2a277ac8-5875-4b1e-9628-5556e809eaf6 req-f88be216-ded1-494b-bdc0-0060fee37159 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] No waiting events found dispatching network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:09:17 user nova-compute[71692]: WARNING nova.compute.manager [req-2a277ac8-5875-4b1e-9628-5556e809eaf6 req-f88be216-ded1-494b-bdc0-0060fee37159 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received unexpected event network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf for instance with vm_state active and task_state shelving.
Apr 13 19:09:17 user nova-compute[71692]: DEBUG nova.network.neutron [req-902093cb-8157-48e9-b077-3de48341cd70 req-7c85ca03-6c66-4352-9fcf-961619823c82 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updated VIF entry in instance network info cache for port 8640b481-7480-494b-a88b-e21419d695cf. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG nova.network.neutron [req-902093cb-8157-48e9-b077-3de48341cd70 req-7c85ca03-6c66-4352-9fcf-961619823c82 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updating instance_info_cache with network_info: [{"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": null, "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8640b481-74", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:09:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-902093cb-8157-48e9-b077-3de48341cd70 req-7c85ca03-6c66-4352-9fcf-961619823c82 service nova] Releasing lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:09:18 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Deleted allocations for instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333
Apr 13 19:09:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:18 user nova-compute[71692]: DEBUG nova.objects.instance [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lazy-loading 'numa_topology' on Instance uuid 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:09:18 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:09:18 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:09:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7b2a1de1-cffd-4d3f-b335-465873bcc090 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.628s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:27 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412952.195033, ee71fe6c-33cc-45aa-b1b7-2d266fa59b04 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:09:27 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] VM Stopped (Lifecycle Event)
Apr 13 19:09:27 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f9dde551-e676-4d45-99a9-0e0e5473f885 None None] [instance: ee71fe6c-33cc-45aa-b1b7-2d266fa59b04] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:09:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "33367b19-4d62-46dc-8346-45ea09c5563d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:28 user nova-compute[71692]: DEBUG nova.compute.manager [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:09:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:28 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:09:28 user nova-compute[71692]: INFO nova.compute.claims [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Claim successful on node user
Apr 13 19:09:29 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG nova.network.neutron [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:09:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:09:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG nova.policy [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4a9282b733244da9bf210ddc66b74816', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1ef6e7b159468f90cfc0db2e8e904d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:09:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Creating image(s)
Apr 13 19:09:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "/opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "/opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "/opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk 1073741824" returned: 0 in 0.048s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.126s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:30 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Cannot resize image /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:09:30 user nova-compute[71692]: DEBUG nova.objects.instance [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lazy-loading 'migration_context' on Instance uuid 33367b19-4d62-46dc-8346-45ea09c5563d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:09:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:09:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Ensure instance console log exists: /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:09:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:30 user nova-compute[71692]: DEBUG nova.network.neutron [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Successfully created port: 6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:09:30 user nova-compute[71692]: DEBUG nova.network.neutron [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Successfully updated port: 6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:09:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:09:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquired lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:09:30 user nova-compute[71692]: DEBUG nova.network.neutron [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:09:30 user nova-compute[71692]: DEBUG nova.compute.manager [req-ef3c6d22-312d-410d-97c1-691d73d58d2a req-9b53e569-62a3-4cc4-8596-03740c36f37d service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-changed-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:09:30 user nova-compute[71692]: DEBUG nova.compute.manager [req-ef3c6d22-312d-410d-97c1-691d73d58d2a req-9b53e569-62a3-4cc4-8596-03740c36f37d service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Refreshing instance network info cache due to event network-changed-6d1659d8-90f3-45a5-90a0-772abe02c673. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:09:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ef3c6d22-312d-410d-97c1-691d73d58d2a req-9b53e569-62a3-4cc4-8596-03740c36f37d service nova] Acquiring lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:09:30 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412955.9686482, 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:09:30 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] VM Stopped (Lifecycle Event)
Apr 13 19:09:30 user nova-compute[71692]: DEBUG nova.compute.manager [None req-cf8e4e20-2a6e-491f-a058-1d0aafdfc8a2 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:09:30 user nova-compute[71692]: DEBUG nova.network.neutron [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.network.neutron [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Updating instance_info_cache with network_info: [{"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Releasing lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.compute.manager [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Instance network_info: |[{"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ef3c6d22-312d-410d-97c1-691d73d58d2a req-9b53e569-62a3-4cc4-8596-03740c36f37d service nova] Acquired lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.network.neutron [req-ef3c6d22-312d-410d-97c1-691d73d58d2a req-9b53e569-62a3-4cc4-8596-03740c36f37d service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Refreshing network info cache for port 6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Start _get_guest_xml network_info=[{"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:09:31 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:09:31 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-972621465',display_name='tempest-ServerStableDeviceRescueTest-server-972621465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-972621465',id=22,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/81JXVWb0rXwxJzcsxAa/8RybinXrc8Zl6qDPwrsL1kZEKNSUSm9I+Uhv2Knu1MvtLPpX14zkVbAGUt4k2gfpkYtA+Jt4hwEGaqZykAeWlkK9tm3g1d//gn87QHubXOQ==',key_name='tempest-keypair-822105464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e1ef6e7b159468f90cfc0db2e8e904d',ramdisk_id='',reservation_id='r-p6e0pmxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-192327838',owner_user_name='tempest-ServerStableDeviceRescueTest-192327838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:09:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a9282b733244da9bf210ddc66b74816',uuid=33367b19-4d62-46dc-8346-45ea09c5563d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Converting VIF {"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:21:e1,bridge_name='br-int',has_traffic_filtering=True,id=6d1659d8-90f3-45a5-90a0-772abe02c673,network=Network(12044ffa-ff1e-492a-b819-a301af851941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d1659d8-90') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.objects.instance [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lazy-loading 'pci_devices' on Instance uuid 33367b19-4d62-46dc-8346-45ea09c5563d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:09:31 user nova-compute[71692]:   <uuid>33367b19-4d62-46dc-8346-45ea09c5563d</uuid>
Apr 13 19:09:31 user nova-compute[71692]:   <name>instance-00000016</name>
Apr 13 19:09:31 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:09:31 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:09:31 user nova-compute[71692]:   <metadata>
Apr 13 19:09:31 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:09:31 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:09:31 user nova-compute[71692]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-972621465</nova:name>
Apr 13 19:09:31 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:09:31</nova:creationTime>
Apr 13 19:09:31 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:09:31 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:09:31 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:09:31 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:09:31 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:09:31 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:09:31 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:09:31 user nova-compute[71692]:       <nova:owner>
Apr 13 19:09:31 user nova-compute[71692]:         <nova:user uuid="4a9282b733244da9bf210ddc66b74816">tempest-ServerStableDeviceRescueTest-192327838-project-member</nova:user>
Apr 13 19:09:31 user nova-compute[71692]:         <nova:project uuid="7e1ef6e7b159468f90cfc0db2e8e904d">tempest-ServerStableDeviceRescueTest-192327838</nova:project>
Apr 13 19:09:31 user nova-compute[71692]:       </nova:owner>
Apr 13 19:09:31 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:09:31 user nova-compute[71692]:       <nova:ports>
Apr 13 19:09:31 user nova-compute[71692]:         <nova:port uuid="6d1659d8-90f3-45a5-90a0-772abe02c673">
Apr 13 19:09:31 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 19:09:31 user nova-compute[71692]:         </nova:port>
Apr 13 19:09:31 user nova-compute[71692]:       </nova:ports>
Apr 13 19:09:31 user nova-compute[71692]:     </nova:instance>
Apr 13 19:09:31 user nova-compute[71692]:   </metadata>
Apr 13 19:09:31 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:09:31 user nova-compute[71692]:     <system>
Apr 13 19:09:31 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:09:31 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:09:31 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:09:31 user nova-compute[71692]:       <entry name="serial">33367b19-4d62-46dc-8346-45ea09c5563d</entry>
Apr 13 19:09:31 user nova-compute[71692]:       <entry name="uuid">33367b19-4d62-46dc-8346-45ea09c5563d</entry>
Apr 13 19:09:31 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:09:31 user nova-compute[71692]:     </system>
Apr 13 19:09:31 user nova-compute[71692]:   </sysinfo>
Apr 13 19:09:31 user nova-compute[71692]:   <os>
Apr 13 19:09:31 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:09:31 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:09:31 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:09:31 user nova-compute[71692]:   </os>
Apr 13 19:09:31 user nova-compute[71692]:   <features>
Apr 13 19:09:31 user nova-compute[71692]:     <acpi/>
Apr 13 19:09:31 user nova-compute[71692]:     <apic/>
Apr 13 19:09:31 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:09:31 user nova-compute[71692]:   </features>
Apr 13 19:09:31 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:09:31 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:09:31 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:09:31 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:09:31 user nova-compute[71692]:   </clock>
Apr 13 19:09:31 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:09:31 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:09:31 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:09:31 user nova-compute[71692]:   </cpu>
Apr 13 19:09:31 user nova-compute[71692]:   <devices>
Apr 13 19:09:31 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:09:31 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:09:31 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk"/>
Apr 13 19:09:31 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:09:31 user nova-compute[71692]:     </disk>
Apr 13 19:09:31 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:09:31 user nova-compute[71692]:       <mac address="fa:16:3e:ac:21:e1"/>
Apr 13 19:09:31 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:09:31 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:09:31 user nova-compute[71692]:       <target dev="tap6d1659d8-90"/>
Apr 13 19:09:31 user nova-compute[71692]:     </interface>
Apr 13 19:09:31 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:09:31 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/console.log" append="off"/>
Apr 13 19:09:31 user nova-compute[71692]:     </serial>
Apr 13 19:09:31 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:09:31 user nova-compute[71692]:     <video>
Apr 13 19:09:31 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:09:31 user nova-compute[71692]:     </video>
Apr 13 19:09:31 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:09:31 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:09:31 user nova-compute[71692]:     </rng>
Apr 13 19:09:31 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:09:31 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:09:31 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:09:31 user nova-compute[71692]:     </memballoon>
Apr 13 19:09:31 user nova-compute[71692]:   </devices>
Apr 13 19:09:31 user nova-compute[71692]: </domain>
Apr 13 19:09:31 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-972621465',display_name='tempest-ServerStableDeviceRescueTest-server-972621465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-972621465',id=22,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/81JXVWb0rXwxJzcsxAa/8RybinXrc8Zl6qDPwrsL1kZEKNSUSm9I+Uhv2Knu1MvtLPpX14zkVbAGUt4k2gfpkYtA+Jt4hwEGaqZykAeWlkK9tm3g1d//gn87QHubXOQ==',key_name='tempest-keypair-822105464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7e1ef6e7b159468f90cfc0db2e8e904d',ramdisk_id='',reservation_id='r-p6e0pmxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-192327838',owner_user_name='tempest-ServerStableDeviceRescueTest-192327838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:09:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a9282b733244da9bf210ddc66b74816',uuid=33367b19-4d62-46dc-8346-45ea09c5563d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Converting VIF {"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:21:e1,bridge_name='br-int',has_traffic_filtering=True,id=6d1659d8-90f3-45a5-90a0-772abe02c673,network=Network(12044ffa-ff1e-492a-b819-a301af851941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d1659d8-90') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG os_vif [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:21:e1,bridge_name='br-int',has_traffic_filtering=True,id=6d1659d8-90f3-45a5-90a0-772abe02c673,network=Network(12044ffa-ff1e-492a-b819-a301af851941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d1659d8-90') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d1659d8-90, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d1659d8-90, col_values=(('external_ids', {'iface-id': '6d1659d8-90f3-45a5-90a0-772abe02c673', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:21:e1', 'vm-uuid': '33367b19-4d62-46dc-8346-45ea09c5563d'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:31 user nova-compute[71692]: INFO os_vif [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:21:e1,bridge_name='br-int',has_traffic_filtering=True,id=6d1659d8-90f3-45a5-90a0-772abe02c673,network=Network(12044ffa-ff1e-492a-b819-a301af851941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d1659d8-90')
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] No VIF found with MAC fa:16:3e:ac:21:e1, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.network.neutron [req-ef3c6d22-312d-410d-97c1-691d73d58d2a req-9b53e569-62a3-4cc4-8596-03740c36f37d service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Updated VIF entry in instance network info cache for port 6d1659d8-90f3-45a5-90a0-772abe02c673. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:09:31 user nova-compute[71692]: DEBUG nova.network.neutron [req-ef3c6d22-312d-410d-97c1-691d73d58d2a req-9b53e569-62a3-4cc4-8596-03740c36f37d service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Updating instance_info_cache with network_info: [{"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:09:32 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ef3c6d22-312d-410d-97c1-691d73d58d2a req-9b53e569-62a3-4cc4-8596-03740c36f37d service nova] Releasing lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:09:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:33 user nova-compute[71692]: DEBUG nova.compute.manager [req-e8f12a9e-3931-4e4e-84ce-d6c8468584e6 req-0ce2ac74-21e7-459b-a317-6793a3d0ab3c service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:09:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e8f12a9e-3931-4e4e-84ce-d6c8468584e6 req-0ce2ac74-21e7-459b-a317-6793a3d0ab3c service nova] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e8f12a9e-3931-4e4e-84ce-d6c8468584e6 req-0ce2ac74-21e7-459b-a317-6793a3d0ab3c service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e8f12a9e-3931-4e4e-84ce-d6c8468584e6 req-0ce2ac74-21e7-459b-a317-6793a3d0ab3c service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:33 user nova-compute[71692]: DEBUG nova.compute.manager [req-e8f12a9e-3931-4e4e-84ce-d6c8468584e6 req-0ce2ac74-21e7-459b-a317-6793a3d0ab3c service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] No waiting events found dispatching network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:09:33 user nova-compute[71692]: WARNING nova.compute.manager [req-e8f12a9e-3931-4e4e-84ce-d6c8468584e6 req-0ce2ac74-21e7-459b-a317-6793a3d0ab3c service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received unexpected event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 for instance with vm_state building and task_state spawning.
Apr 13 19:09:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:34 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412975.1358573, 33367b19-4d62-46dc-8346-45ea09c5563d => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:09:35 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] VM Resumed (Lifecycle Event)
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:09:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Instance spawned successfully.
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:09:35 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681412975.1395435, 33367b19-4d62-46dc-8346-45ea09c5563d => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:09:35 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] VM Started (Lifecycle Event)
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:09:35 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:09:35 user nova-compute[71692]: INFO nova.compute.manager [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Took 5.86 seconds to spawn the instance on the hypervisor.
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.compute.manager [req-ea18c8aa-70f8-4f9d-b0b3-0d87c3301c47 req-170f4cc0-ab2f-45b7-ab3a-1b3eb9550935 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ea18c8aa-70f8-4f9d-b0b3-0d87c3301c47 req-170f4cc0-ab2f-45b7-ab3a-1b3eb9550935 service nova] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ea18c8aa-70f8-4f9d-b0b3-0d87c3301c47 req-170f4cc0-ab2f-45b7-ab3a-1b3eb9550935 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ea18c8aa-70f8-4f9d-b0b3-0d87c3301c47 req-170f4cc0-ab2f-45b7-ab3a-1b3eb9550935 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:35 user nova-compute[71692]: DEBUG nova.compute.manager [req-ea18c8aa-70f8-4f9d-b0b3-0d87c3301c47 req-170f4cc0-ab2f-45b7-ab3a-1b3eb9550935 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] No waiting events found dispatching network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:09:35 user nova-compute[71692]: WARNING nova.compute.manager [req-ea18c8aa-70f8-4f9d-b0b3-0d87c3301c47 req-170f4cc0-ab2f-45b7-ab3a-1b3eb9550935 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received unexpected event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 for instance with vm_state building and task_state spawning.
Apr 13 19:09:35 user nova-compute[71692]: INFO nova.compute.manager [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Took 6.50 seconds to build instance.
Apr 13 19:09:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-23f831d5-c5ee-4942-9fb6-60a1640aab4b tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "33367b19-4d62-46dc-8346-45ea09c5563d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.593s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:36 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:09:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:09:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:09:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-7e4c1d44-8208-41ff-872f-706d4b67058e req-524865f6-cf2e-4ec2-b3f4-79ef5a7e2812 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Received event network-changed-24610878-c15b-4646-9dcf-ef49c99ae208 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:09:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-7e4c1d44-8208-41ff-872f-706d4b67058e req-524865f6-cf2e-4ec2-b3f4-79ef5a7e2812 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Refreshing instance network info cache due to event network-changed-24610878-c15b-4646-9dcf-ef49c99ae208. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:09:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7e4c1d44-8208-41ff-872f-706d4b67058e req-524865f6-cf2e-4ec2-b3f4-79ef5a7e2812 service nova] Acquiring lock "refresh_cache-32751522-5725-4cb4-a8bd-234dfe84780b" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:09:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7e4c1d44-8208-41ff-872f-706d4b67058e req-524865f6-cf2e-4ec2-b3f4-79ef5a7e2812 service nova] Acquired lock "refresh_cache-32751522-5725-4cb4-a8bd-234dfe84780b" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:09:39 user nova-compute[71692]: DEBUG nova.network.neutron [req-7e4c1d44-8208-41ff-872f-706d4b67058e req-524865f6-cf2e-4ec2-b3f4-79ef5a7e2812 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Refreshing network info cache for port 24610878-c15b-4646-9dcf-ef49c99ae208 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:09:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "32751522-5725-4cb4-a8bd-234dfe84780b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "32751522-5725-4cb4-a8bd-234dfe84780b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:39 user nova-compute[71692]: DEBUG nova.objects.instance [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lazy-loading 'flavor' on Instance uuid 32751522-5725-4cb4-a8bd-234dfe84780b {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:09:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "32751522-5725-4cb4-a8bd-234dfe84780b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "32751522-5725-4cb4-a8bd-234dfe84780b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "32751522-5725-4cb4-a8bd-234dfe84780b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:40 user nova-compute[71692]: INFO nova.compute.manager [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Attaching volume 3d1dd6ab-d35d-415e-a184-8b4a46396a07 to /dev/vdb
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG os_brick.utils [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8372f4c-ab17-4a73-9a75-dcac2897fc56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-59d7b86a-c723-4255-827e-2f6a641239df" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-59d7b86a-c723-4255-827e-2f6a641239df" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd7ed30-d454-4916-ad84-dc593e6b2cf1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG nova.network.neutron [req-7e4c1d44-8208-41ff-872f-706d4b67058e req-524865f6-cf2e-4ec2-b3f4-79ef5a7e2812 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Updated VIF entry in instance network info cache for port 24610878-c15b-4646-9dcf-ef49c99ae208. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG nova.network.neutron [req-7e4c1d44-8208-41ff-872f-706d4b67058e req-524865f6-cf2e-4ec2-b3f4-79ef5a7e2812 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Updating instance_info_cache with network_info: [{"id": "24610878-c15b-4646-9dcf-ef49c99ae208", "address": "fa:16:3e:42:91:a8", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24610878-c1", "ovs_interfaceid": "24610878-c15b-4646-9dcf-ef49c99ae208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[33975d22-0516-4bbe-92af-b3e449a9aafd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c42e63-aa60-4a9d-90a8-ba9842f0bdaa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7e4c1d44-8208-41ff-872f-706d4b67058e req-524865f6-cf2e-4ec2-b3f4-79ef5a7e2812 service nova] Releasing lock "refresh_cache-32751522-5725-4cb4-a8bd-234dfe84780b" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:09:40 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa2e4cf-90d2-4ba3-99fb-e711c19585c3]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG os_brick.utils [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Updating existing volume attachment record: 028f5b48-9394-4e5a-b14c-5cc3374bb50a {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Updating instance_info_cache with network_info: [{"id": "3de4b459-2a9f-4570-80b1-dce61f40a377", "address": "fa:16:3e:de:c1:80", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4b459-2a", "ovs_interfaceid": "3de4b459-2a9f-4570-80b1-dce61f40a377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-59d7b86a-c723-4255-827e-2f6a641239df" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:09:40 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:09:41 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:09:41 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:09:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:41 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:09:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk.rescue --force-share --output=json" returned: 0 in 0.127s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:09:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:44 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:09:44 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:09:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=7964MB free_disk=26.104167938232422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 59d7b86a-c723-4255-827e-2f6a641239df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance cb3fb753-ff8d-4dac-ab70-f940233bf25d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 32751522-5725-4cb4-a8bd-234dfe84780b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 33367b19-4d62-46dc-8346-45ea09c5563d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.395s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWIUQDsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:09:44 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:09:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:09:44 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:09:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:09:44 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b434fe-274d-41f1-a3a1-5b3abd41bc7b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:09:44 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a30a19-5738-4506-9f57-753d8cf58609]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07] added
Apr 13 19:09:44 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1616bc66-0d97-45a8-8f40-c3272be97910]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bda5262-6baf-4a97-bf14-5783b996fab1]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWIUQDsX {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWIUQDsX" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed8b32d-81ea-4758-be4d-5155c8f81147]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xWIUQDsX'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b77de66-542f-4765-8161-c7552f0d6a56]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dcb92f-040d-4391-bfbb-c3595acf5360]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:09:44 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:09:44 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:09:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ee42eb-c294-46b0-8f53-ebc5f009c8eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07, portal: 172.16.0.220,3260]
Apr 13 19:09:45 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07, portal: 172.16.0.220,3260] successful.
Apr 13 19:09:45 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4b9910-fd59-466c-bfb5-299941a81b2a]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f25a8d-5da6-4402-a366-beb6af6bea63]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:09:45 user nova-compute[71692]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 (non-flash)
Apr 13 19:09:45 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:09:45 user nova-compute[71692]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 (non-flash)
Apr 13 19:09:45 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[363c4eac-cbed-4c5d-8ce5-4170fe8e4cc6]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:09:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWIUQDsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23935616562356662', 'path': '/dev/sdb'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935616562356662', 'path': '/dev/sdb'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG nova.objects.instance [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lazy-loading 'flavor' on Instance uuid 32751522-5725-4cb4-a8bd-234dfe84780b {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:09:46 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:09:46 user nova-compute[71692]:   <source dev="/dev/sdb"/>
Apr 13 19:09:46 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:09:46 user nova-compute[71692]:   <serial>3d1dd6ab-d35d-415e-a184-8b4a46396a07</serial>
Apr 13 19:09:46 user nova-compute[71692]: </disk>
Apr 13 19:09:46 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:46 user nova-compute[71692]: INFO nova.compute.manager [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Terminating instance
Apr 13 19:09:46 user nova-compute[71692]: DEBUG nova.compute.manager [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] No VIF found with MAC fa:16:3e:42:91:a8, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG nova.compute.manager [req-514c9d9f-fd86-415b-ad24-f0cbcc18f2f9 req-8cf62c91-230f-4de2-88b9-f3abcdc3667d service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-vif-unplugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-514c9d9f-fd86-415b-ad24-f0cbcc18f2f9 req-8cf62c91-230f-4de2-88b9-f3abcdc3667d service nova] Acquiring lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-514c9d9f-fd86-415b-ad24-f0cbcc18f2f9 req-8cf62c91-230f-4de2-88b9-f3abcdc3667d service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-514c9d9f-fd86-415b-ad24-f0cbcc18f2f9 req-8cf62c91-230f-4de2-88b9-f3abcdc3667d service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG nova.compute.manager [req-514c9d9f-fd86-415b-ad24-f0cbcc18f2f9 req-8cf62c91-230f-4de2-88b9-f3abcdc3667d service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] No waiting events found dispatching network-vif-unplugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG nova.compute.manager [req-514c9d9f-fd86-415b-ad24-f0cbcc18f2f9 req-8cf62c91-230f-4de2-88b9-f3abcdc3667d service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-vif-unplugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-039d0289-ab40-4bda-8643-26ab5bf9352c tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "32751522-5725-4cb4-a8bd-234dfe84780b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.565s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:46 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:09:46 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Instance destroyed successfully.
Apr 13 19:09:46 user nova-compute[71692]: DEBUG nova.objects.instance [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lazy-loading 'resources' on Instance uuid 2c2e4899-d6d5-422c-a4f1-61a8129abdae {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:09:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T19:04:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1141253084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1141253084',id=16,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZe8WHxNPt+OEFTfKSkzy8wZuScIjzJeyBVbA3Z02RJMRIdLJty1zSrwoxsbVtyU7kpmUkL2gYS28J8h+WxdhP9nXELXUDvHj2w4B2VNtkzNPMfJnxeWpbUzlRv0BK2Kg==',key_name='tempest-keypair-1280930280',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:08:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='faabdcc8e61c452ab3b934b1c9501e68',ramdisk_id='',reservation_id='r-r0g030ti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1546308967',owner_user_name='tempest-AttachVolumeShelveTestJSON-1546308967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:08:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee6c76c605d54b4f84e0596b27087f0b',uuid=2c2e4899-d6d5-422c-a4f1-61a8129abdae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:09:47 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converting VIF {"id": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "address": "fa:16:3e:bd:dd:1f", "network": {"id": "9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-465416384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "faabdcc8e61c452ab3b934b1c9501e68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap071fd8c9-94", "ovs_interfaceid": "071fd8c9-9400-42aa-ad88-1176bb1d4910", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:09:47 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:dd:1f,bridge_name='br-int',has_traffic_filtering=True,id=071fd8c9-9400-42aa-ad88-1176bb1d4910,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071fd8c9-94') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:09:47 user nova-compute[71692]: DEBUG os_vif [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:dd:1f,bridge_name='br-int',has_traffic_filtering=True,id=071fd8c9-9400-42aa-ad88-1176bb1d4910,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071fd8c9-94') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:09:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap071fd8c9-94, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:09:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:09:47 user nova-compute[71692]: INFO os_vif [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:dd:1f,bridge_name='br-int',has_traffic_filtering=True,id=071fd8c9-9400-42aa-ad88-1176bb1d4910,network=Network(9ff42a6b-d67e-4b9e-b50b-3a4dcbb41fab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap071fd8c9-94')
Apr 13 19:09:47 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Deleting instance files /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae_del
Apr 13 19:09:47 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Deletion of /opt/stack/data/nova/instances/2c2e4899-d6d5-422c-a4f1-61a8129abdae_del complete
Apr 13 19:09:47 user nova-compute[71692]: INFO nova.compute.manager [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 13 19:09:47 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:09:47 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:09:47 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:09:47 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:09:47 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Took 0.81 seconds to deallocate network for instance.
Apr 13 19:09:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-7da0123b-6c09-47db-967a-266c0908b38c req-3ca7570a-df4d-4526-85a5-80d8f9900e9f service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-vif-deleted-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:09:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "32751522-5725-4cb4-a8bd-234dfe84780b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "32751522-5725-4cb4-a8bd-234dfe84780b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:48 user nova-compute[71692]: INFO nova.compute.manager [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Detaching volume 3d1dd6ab-d35d-415e-a184-8b4a46396a07
Apr 13 19:09:48 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:09:48 user nova-compute[71692]: INFO nova.virt.block_device [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Attempting to driver detach volume 3d1dd6ab-d35d-415e-a184-8b4a46396a07 from mountpoint /dev/vdb
Apr 13 19:09:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Attempting to detach device vdb from instance 32751522-5725-4cb4-a8bd-234dfe84780b from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:09:48 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:09:48 user nova-compute[71692]:   <source dev="/dev/sdb"/>
Apr 13 19:09:48 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:09:48 user nova-compute[71692]:   <serial>3d1dd6ab-d35d-415e-a184-8b4a46396a07</serial>
Apr 13 19:09:48 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:09:48 user nova-compute[71692]: </disk>
Apr 13 19:09:48 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:48 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Successfully detached device vdb from instance 32751522-5725-4cb4-a8bd-234dfe84780b from the persistent domain config.
Apr 13 19:09:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 32751522-5725-4cb4-a8bd-234dfe84780b from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:09:48 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:09:48 user nova-compute[71692]:   <source dev="/dev/sdb"/>
Apr 13 19:09:48 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:09:48 user nova-compute[71692]:   <serial>3d1dd6ab-d35d-415e-a184-8b4a46396a07</serial>
Apr 13 19:09:48 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:09:48 user nova-compute[71692]: </disk>
Apr 13 19:09:48 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:09:48 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Deleted allocations for instance 2c2e4899-d6d5-422c-a4f1-61a8129abdae
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-73d2ef8c-bdc6-4732-8cd6-0bdcf59a45b4 tempest-AttachVolumeShelveTestJSON-1546308967 tempest-AttachVolumeShelveTestJSON-1546308967-project-member] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.102s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681412988.5760486, 32751522-5725-4cb4-a8bd-234dfe84780b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 32751522-5725-4cb4-a8bd-234dfe84780b {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:09:48 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Successfully detached device vdb from instance 32751522-5725-4cb4-a8bd-234dfe84780b from the live domain config.
Apr 13 19:09:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWIUQDsX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:09:48 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4183000f-4e3a-4e56-abbd-2080fd7951b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:09:48 user nova-compute[71692]: No targets found.
Apr 13 19:09:48 user nova-compute[71692]: iSNS:
Apr 13 19:09:48 user nova-compute[71692]: No targets found.
Apr 13 19:09:48 user nova-compute[71692]: STATIC:
Apr 13 19:09:48 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414
Apr 13 19:09:48 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:09:48 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:09:48 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07
Apr 13 19:09:48 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:09:48 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:09:48 user nova-compute[71692]: FIRMWARE:
Apr 13 19:09:48 user nova-compute[71692]: No targets found.
Apr 13 19:09:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:09:48 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:09:48 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG nova.compute.manager [req-a66058b0-facd-47bd-a3b8-ed2c14acb472 req-db83a8c5-6d47-4238-9f89-4500a0bd25d6 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a66058b0-facd-47bd-a3b8-ed2c14acb472 req-db83a8c5-6d47-4238-9f89-4500a0bd25d6 service nova] Acquiring lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a66058b0-facd-47bd-a3b8-ed2c14acb472 req-db83a8c5-6d47-4238-9f89-4500a0bd25d6 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a66058b0-facd-47bd-a3b8-ed2c14acb472 req-db83a8c5-6d47-4238-9f89-4500a0bd25d6 service nova] Lock "2c2e4899-d6d5-422c-a4f1-61a8129abdae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG nova.compute.manager [req-a66058b0-facd-47bd-a3b8-ed2c14acb472 req-db83a8c5-6d47-4238-9f89-4500a0bd25d6 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] No waiting events found dispatching network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:09:48 user nova-compute[71692]: WARNING nova.compute.manager [req-a66058b0-facd-47bd-a3b8-ed2c14acb472 req-db83a8c5-6d47-4238-9f89-4500a0bd25d6 service nova] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Received unexpected event network-vif-plugged-071fd8c9-9400-42aa-ad88-1176bb1d4910 for instance with vm_state deleted and task_state None.
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cb435d-8a86-4af9-8180-24cb89438de8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f61a9a-e3a8-4660-9a63-9d1edd4569a7]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:09:48 user nova-compute[71692]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 (non-flash)
Apr 13 19:09:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:09:48 user nova-compute[71692]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 (non-flash)
Apr 13 19:09:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febd8b5f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07'): ({'sdb'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Removing single pathed devices sdb {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff428713-3e98-44b6-b466-50be17f2266d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[01074287-a8c2-4e06-9927-3dc9ede1ea27]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Flushing IO for device /dev/sdb {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[59643a47-4b67-4d70-90ee-9e3b0d434bb8]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92e79a0-4122-48d5-af94-b809c2913e7c]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8136326-cf38-4204-91b0-0e2f3c370195]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[abea866b-a496-420f-82ad-58952ca6dfaf]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07, portal: 172.16.0.220,3260]
Apr 13 19:09:48 user nova-compute[71692]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07, portal: 172.16.0.220,3260] successful.
Apr 13 19:09:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1dd6ab-d35d-415e-a184-8b4a46396a07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5453d5ca-d084-48e9-87ca-4188df978bea]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] <== disconnect_volume: return (304ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:09:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:09:49 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lazy-loading 'flavor' on Instance uuid 32751522-5725-4cb4-a8bd-234dfe84780b {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:09:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e65ffe61-2420-4d00-b9f2-a4894a562069 tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "32751522-5725-4cb4-a8bd-234dfe84780b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.547s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:09:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:09:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:01 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681412986.991624, 2c2e4899-d6d5-422c-a4f1-61a8129abdae => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:10:01 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] VM Stopped (Lifecycle Event)
Apr 13 19:10:02 user nova-compute[71692]: DEBUG nova.compute.manager [None req-71dcaf58-5e06-4ac9-8d45-add393dd6b55 None None] [instance: 2c2e4899-d6d5-422c-a4f1-61a8129abdae] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:10:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:17 user nova-compute[71692]: INFO nova.compute.manager [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Terminating instance
Apr 13 19:10:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-7e31c3d4-7f26-4be2-b200-cc1f9c4583e7 req-2f0a5665-88c6-4f1c-ab68-3e9fdf798dd8 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-unplugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7e31c3d4-7f26-4be2-b200-cc1f9c4583e7 req-2f0a5665-88c6-4f1c-ab68-3e9fdf798dd8 service nova] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7e31c3d4-7f26-4be2-b200-cc1f9c4583e7 req-2f0a5665-88c6-4f1c-ab68-3e9fdf798dd8 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7e31c3d4-7f26-4be2-b200-cc1f9c4583e7 req-2f0a5665-88c6-4f1c-ab68-3e9fdf798dd8 service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-7e31c3d4-7f26-4be2-b200-cc1f9c4583e7 req-2f0a5665-88c6-4f1c-ab68-3e9fdf798dd8 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] No waiting events found dispatching network-vif-unplugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-7e31c3d4-7f26-4be2-b200-cc1f9c4583e7 req-2f0a5665-88c6-4f1c-ab68-3e9fdf798dd8 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-unplugged-2b297ca1-e672-438a-917a-df2319262bc0 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:10:17 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Instance destroyed successfully.
Apr 13 19:10:17 user nova-compute[71692]: DEBUG nova.objects.instance [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'resources' on Instance uuid b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T18:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-657008190',display_name='tempest-ServerActionsTestJSON-server-1417744922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-657008190',id=5,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:07:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-zw23yzik',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:07:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2b297ca1-e672-438a-917a-df2319262bc0", "address": "fa:16:3e:bc:71:09", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b297ca1-e6", "ovs_interfaceid": "2b297ca1-e672-438a-917a-df2319262bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG os_vif [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b297ca1-e6, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:10:17 user nova-compute[71692]: INFO os_vif [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:71:09,bridge_name='br-int',has_traffic_filtering=True,id=2b297ca1-e672-438a-917a-df2319262bc0,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b297ca1-e6')
Apr 13 19:10:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dyHemtYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:10:17 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:10:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dd1271-511e-4f36-958f-5e57a75c953d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:10:17 user nova-compute[71692]: No targets found.
Apr 13 19:10:17 user nova-compute[71692]: iSNS:
Apr 13 19:10:17 user nova-compute[71692]: No targets found.
Apr 13 19:10:17 user nova-compute[71692]: STATIC:
Apr 13 19:10:17 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414
Apr 13 19:10:17 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:10:17 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:10:17 user nova-compute[71692]: FIRMWARE:
Apr 13 19:10:17 user nova-compute[71692]: No targets found.
Apr 13 19:10:17 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:10:17 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:10:17 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25615d7-452a-480f-812e-e2c0d2c5c51e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef86c429-730d-4235-bff3-f2dfac285d59]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:10:17 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 (non-flash)
Apr 13 19:10:17 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febd8ba2680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414'): ({'sdf'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Removing single pathed devices sdf {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd6f696-987c-4b50-8db6-4c867d6a2a53]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:10:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b91cefe-ce44-4ad2-80f2-1546226b5f00]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flushing IO for device /dev/sdf {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1d9783-9a32-4ca5-9f57-4e0066bba283]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[814eb46b-71d1-404f-a61c-70350ff73f32]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] SCSI volumes sdf have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc267bdc-6f68-4172-9380-d2fdd519a5d1]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[87749070-d59b-48a8-a717-392eb9718718]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260]
Apr 13 19:10:18 user nova-compute[71692]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414, portal: 172.16.0.220,3260] successful.
Apr 13 19:10:18 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50a307e4-f870-4d27-ba29-f61e22e6a414 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f909f6-311d-4311-8623-c1ee77694511]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== disconnect_volume: return (303ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:10:18 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Deleting instance files /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8_del
Apr 13 19:10:18 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Deletion of /opt/stack/data/nova/instances/b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8_del complete
Apr 13 19:10:18 user nova-compute[71692]: INFO nova.compute.manager [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 13 19:10:18 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:10:18 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:10:19 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:10:19 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Took 1.03 seconds to deallocate network for instance.
Apr 13 19:10:19 user nova-compute[71692]: DEBUG nova.compute.manager [req-9f0ae740-2c76-4f76-8483-a2b2f93f25bf req-12f0a1b7-bcc4-4e37-a5b2-d469d7b813d8 service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-deleted-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:10:20 user nova-compute[71692]: DEBUG nova.compute.manager [req-433dce35-7dde-4ebc-b904-763e5277b7ee req-29ffa09b-5f63-41de-a368-6e9cdeb7f2fc service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:10:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-433dce35-7dde-4ebc-b904-763e5277b7ee req-29ffa09b-5f63-41de-a368-6e9cdeb7f2fc service nova] Acquiring lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-433dce35-7dde-4ebc-b904-763e5277b7ee req-29ffa09b-5f63-41de-a368-6e9cdeb7f2fc service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-433dce35-7dde-4ebc-b904-763e5277b7ee req-29ffa09b-5f63-41de-a368-6e9cdeb7f2fc service nova] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:20 user nova-compute[71692]: DEBUG nova.compute.manager [req-433dce35-7dde-4ebc-b904-763e5277b7ee req-29ffa09b-5f63-41de-a368-6e9cdeb7f2fc service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] No waiting events found dispatching network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:10:20 user nova-compute[71692]: WARNING nova.compute.manager [req-433dce35-7dde-4ebc-b904-763e5277b7ee req-29ffa09b-5f63-41de-a368-6e9cdeb7f2fc service nova] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Received unexpected event network-vif-plugged-2b297ca1-e672-438a-917a-df2319262bc0 for instance with vm_state active and task_state deleting.
Apr 13 19:10:20 user nova-compute[71692]: INFO nova.compute.manager [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Took 0.77 seconds to detach 1 volumes for instance.
Apr 13 19:10:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:20 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:10:20 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:10:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.234s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:20 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Deleted allocations for instance b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8
Apr 13 19:10:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f045c81e-c157-4a9a-b156-63fa58959189 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.421s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:25 user nova-compute[71692]: INFO nova.compute.manager [None req-3883861b-ce51-4639-903d-1544dbf01479 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Unrescuing
Apr 13 19:10:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3883861b-ce51-4639-903d-1544dbf01479 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:10:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3883861b-ce51-4639-903d-1544dbf01479 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquired lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:10:25 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3883861b-ce51-4639-903d-1544dbf01479 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:10:26 user nova-compute[71692]: DEBUG nova.network.neutron [None req-3883861b-ce51-4639-903d-1544dbf01479 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Updating instance_info_cache with network_info: [{"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:10:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3883861b-ce51-4639-903d-1544dbf01479 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Releasing lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:10:26 user nova-compute[71692]: DEBUG nova.objects.instance [None req-3883861b-ce51-4639-903d-1544dbf01479 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'flavor' on Instance uuid 29eeca99-f237-49d9-9c7d-5c5b7ff2892f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:10:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:26 user nova-compute[71692]: DEBUG nova.compute.manager [req-b4cae10e-9d35-4fc3-a637-d25bc2b435c8 req-8bf662a7-0cdd-4d8f-83ca-54c0767ddb92 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received event network-vif-unplugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:10:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b4cae10e-9d35-4fc3-a637-d25bc2b435c8 req-8bf662a7-0cdd-4d8f-83ca-54c0767ddb92 service nova] Acquiring lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b4cae10e-9d35-4fc3-a637-d25bc2b435c8 req-8bf662a7-0cdd-4d8f-83ca-54c0767ddb92 service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b4cae10e-9d35-4fc3-a637-d25bc2b435c8 req-8bf662a7-0cdd-4d8f-83ca-54c0767ddb92 service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:26 user nova-compute[71692]: DEBUG nova.compute.manager [req-b4cae10e-9d35-4fc3-a637-d25bc2b435c8 req-8bf662a7-0cdd-4d8f-83ca-54c0767ddb92 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] No waiting events found dispatching network-vif-unplugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:10:26 user nova-compute[71692]: WARNING nova.compute.manager [req-b4cae10e-9d35-4fc3-a637-d25bc2b435c8 req-8bf662a7-0cdd-4d8f-83ca-54c0767ddb92 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received unexpected event network-vif-unplugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance with vm_state rescued and task_state unrescuing.
Apr 13 19:10:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:26 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Instance destroyed successfully.
Apr 13 19:10:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:28 user nova-compute[71692]: DEBUG nova.compute.manager [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:10:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] Acquiring lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:28 user nova-compute[71692]: DEBUG nova.compute.manager [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] No waiting events found dispatching network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:10:28 user nova-compute[71692]: WARNING nova.compute.manager [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received unexpected event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance with vm_state rescued and task_state unrescuing.
Apr 13 19:10:28 user nova-compute[71692]: DEBUG nova.compute.manager [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:10:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] Acquiring lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:28 user nova-compute[71692]: DEBUG nova.compute.manager [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] No waiting events found dispatching network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:10:28 user nova-compute[71692]: WARNING nova.compute.manager [req-05348d1b-5874-4563-b933-79afae0b495c req-cad38d44-4414-4834-9890-c4e3a66ec16b service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received unexpected event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance with vm_state rescued and task_state unrescuing.
Apr 13 19:10:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Removed pending event for 29eeca99-f237-49d9-9c7d-5c5b7ff2892f due to event {{(pid=71692) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 19:10:30 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413030.2536378, 29eeca99-f237-49d9-9c7d-5c5b7ff2892f => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:10:30 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] VM Resumed (Lifecycle Event)
Apr 13 19:10:30 user nova-compute[71692]: DEBUG nova.compute.manager [None req-3883861b-ce51-4639-903d-1544dbf01479 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:10:30 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:10:30 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:10:30 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 19:10:30 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413030.2576356, 29eeca99-f237-49d9-9c7d-5c5b7ff2892f => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:10:30 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] VM Started (Lifecycle Event)
Apr 13 19:10:30 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:10:30 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:10:30 user nova-compute[71692]: DEBUG nova.compute.manager [req-6a12f3d6-f627-4d3c-bf37-3aa670b94ff1 req-b3187024-34a5-42e5-873d-d34e89e73e60 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:10:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6a12f3d6-f627-4d3c-bf37-3aa670b94ff1 req-b3187024-34a5-42e5-873d-d34e89e73e60 service nova] Acquiring lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6a12f3d6-f627-4d3c-bf37-3aa670b94ff1 req-b3187024-34a5-42e5-873d-d34e89e73e60 service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6a12f3d6-f627-4d3c-bf37-3aa670b94ff1 req-b3187024-34a5-42e5-873d-d34e89e73e60 service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:30 user nova-compute[71692]: DEBUG nova.compute.manager [req-6a12f3d6-f627-4d3c-bf37-3aa670b94ff1 req-b3187024-34a5-42e5-873d-d34e89e73e60 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] No waiting events found dispatching network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:10:30 user nova-compute[71692]: WARNING nova.compute.manager [req-6a12f3d6-f627-4d3c-bf37-3aa670b94ff1 req-b3187024-34a5-42e5-873d-d34e89e73e60 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received unexpected event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance with vm_state active and task_state None.
Apr 13 19:10:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:32 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413017.859429, b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:10:32 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] VM Stopped (Lifecycle Event)
Apr 13 19:10:32 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a9105d7a-1f18-4d63-9997-649c0eef3d3b None None] [instance: b31927e7-f2d2-4bb3-93cb-ff8fc7fa68f8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:10:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:34 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:10:35 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:10:37 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:10:37 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:10:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:10:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:10:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "635717f5-c514-41a7-b9dc-a03d699173c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "635717f5-c514-41a7-b9dc-a03d699173c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:10:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:38 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:10:38 user nova-compute[71692]: INFO nova.compute.claims [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Claim successful on node user
Apr 13 19:10:38 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:10:38 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:10:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:10:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:10:38 user nova-compute[71692]: DEBUG nova.network.neutron [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:10:38 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:10:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-6697c580-bb7c-42bb-890b-ca2864e0474e req-9885a84d-c05b-4423-ad55-c8548637c3a8 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Received event network-changed-24610878-c15b-4646-9dcf-ef49c99ae208 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-6697c580-bb7c-42bb-890b-ca2864e0474e req-9885a84d-c05b-4423-ad55-c8548637c3a8 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Refreshing instance network info cache due to event network-changed-24610878-c15b-4646-9dcf-ef49c99ae208. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6697c580-bb7c-42bb-890b-ca2864e0474e req-9885a84d-c05b-4423-ad55-c8548637c3a8 service nova] Acquiring lock "refresh_cache-32751522-5725-4cb4-a8bd-234dfe84780b" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6697c580-bb7c-42bb-890b-ca2864e0474e req-9885a84d-c05b-4423-ad55-c8548637c3a8 service nova] Acquired lock "refresh_cache-32751522-5725-4cb4-a8bd-234dfe84780b" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG nova.network.neutron [req-6697c580-bb7c-42bb-890b-ca2864e0474e req-9885a84d-c05b-4423-ad55-c8548637c3a8 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Refreshing network info cache for port 24610878-c15b-4646-9dcf-ef49c99ae208 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG nova.policy [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80063ed703d24a1b84aede724db205a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2877676ccbd0484d80ecabf3030c0ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:10:39 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Creating image(s)
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "/opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "/opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "/opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "32751522-5725-4cb4-a8bd-234dfe84780b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "32751522-5725-4cb4-a8bd-234dfe84780b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "32751522-5725-4cb4-a8bd-234dfe84780b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "32751522-5725-4cb4-a8bd-234dfe84780b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "32751522-5725-4cb4-a8bd-234dfe84780b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:39 user nova-compute[71692]: INFO nova.compute.manager [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Terminating instance
Apr 13 19:10:39 user nova-compute[71692]: DEBUG nova.compute.manager [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.180s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5/disk 1073741824" returned: 0 in 0.058s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.147s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Checking if we can resize image /opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Cannot resize image /opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG nova.objects.instance [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lazy-loading 'migration_context' on Instance uuid 635717f5-c514-41a7-b9dc-a03d699173c5 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Ensure instance console log exists: /opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG nova.network.neutron [req-6697c580-bb7c-42bb-890b-ca2864e0474e req-9885a84d-c05b-4423-ad55-c8548637c3a8 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Updated VIF entry in instance network info cache for port 24610878-c15b-4646-9dcf-ef49c99ae208. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG nova.network.neutron [req-6697c580-bb7c-42bb-890b-ca2864e0474e req-9885a84d-c05b-4423-ad55-c8548637c3a8 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Updating instance_info_cache with network_info: [{"id": "24610878-c15b-4646-9dcf-ef49c99ae208", "address": "fa:16:3e:42:91:a8", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24610878-c1", "ovs_interfaceid": "24610878-c15b-4646-9dcf-ef49c99ae208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:10:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6697c580-bb7c-42bb-890b-ca2864e0474e req-9885a84d-c05b-4423-ad55-c8548637c3a8 service nova] Releasing lock "refresh_cache-32751522-5725-4cb4-a8bd-234dfe84780b" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:10:40 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Instance destroyed successfully.
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.objects.instance [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lazy-loading 'resources' on Instance uuid 32751522-5725-4cb4-a8bd-234dfe84780b {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-386852633',display_name='tempest-TestStampPattern-server-386852633',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-386852633',id=21,image_ref='9d6be829-be2c-4e1a-bcdd-c919a67a76ec',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHlW3C03mbx8npnGQJlBa+Z8VKTTGNO9FQPBpbP73f2RM1T737WN8fLrDdW9N64l6RsTGIQydByfuY41AlVN9GkKHEdIxhoJ63MlO2Jt2MVwCLy66RUUbGjTxXc1hX0iw==',key_name='tempest-TestStampPattern-550784019',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:07:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3347c59f4ca945399a4323e689460d12',ramdisk_id='',reservation_id='r-7702wosi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='cb3fb753-ff8d-4dac-ab70-f940233bf25d',image_min_disk='1',image_min_ram='0',image_owner_id='3347c59f4ca945399a4323e689460d12',image_owner_project_name='tempest-TestStampPattern-456915878',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-456915878-project-member',image_user_id='cb7bcc69770a4859904f1b66cece61e3',owner_project_name='tempest-TestStampPattern-456915878',owner_user_name='tempest-TestStampPattern-456915878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:07:54Z,user_data=None,user_id='cb7bcc69770a4859904f1b66cece61e3',uuid=32751522-5725-4cb4-a8bd-234dfe84780b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24610878-c15b-4646-9dcf-ef49c99ae208", "address": "fa:16:3e:42:91:a8", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24610878-c1", "ovs_interfaceid": "24610878-c15b-4646-9dcf-ef49c99ae208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Converting VIF {"id": "24610878-c15b-4646-9dcf-ef49c99ae208", "address": "fa:16:3e:42:91:a8", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24610878-c1", "ovs_interfaceid": "24610878-c15b-4646-9dcf-ef49c99ae208", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:91:a8,bridge_name='br-int',has_traffic_filtering=True,id=24610878-c15b-4646-9dcf-ef49c99ae208,network=Network(a5157bcb-9174-46af-b786-e4b159907e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24610878-c1') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG os_vif [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:91:a8,bridge_name='br-int',has_traffic_filtering=True,id=24610878-c15b-4646-9dcf-ef49c99ae208,network=Network(a5157bcb-9174-46af-b786-e4b159907e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24610878-c1') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24610878-c1, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:10:40 user nova-compute[71692]: INFO os_vif [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:91:a8,bridge_name='br-int',has_traffic_filtering=True,id=24610878-c15b-4646-9dcf-ef49c99ae208,network=Network(a5157bcb-9174-46af-b786-e4b159907e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24610878-c1')
Apr 13 19:10:40 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Deleting instance files /opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b_del
Apr 13 19:10:40 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Deletion of /opt/stack/data/nova/instances/32751522-5725-4cb4-a8bd-234dfe84780b_del complete
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Successfully created port: 78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:10:40 user nova-compute[71692]: INFO nova.compute.manager [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 13 19:10:40 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-cb3fb753-ff8d-4dac-ab70-f940233bf25d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-cb3fb753-ff8d-4dac-ab70-f940233bf25d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:10:40 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Took 0.49 seconds to deallocate network for instance.
Apr 13 19:10:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Updating instance_info_cache with network_info: [{"id": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "address": "fa:16:3e:fd:ca:76", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec3cf4d-fe", "ovs_interfaceid": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-cb3fb753-ff8d-4dac-ab70-f940233bf25d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Successfully updated port: 78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "refresh_cache-635717f5-c514-41a7-b9dc-a03d699173c5" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquired lock "refresh_cache-635717f5-c514-41a7-b9dc-a03d699173c5" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-7f7600fa-60c7-48ab-9c0d-a955b97d262f req-5fc3b8ed-e11a-4ca6-b0a0-1f3bb435a947 service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Received event network-changed-78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-7f7600fa-60c7-48ab-9c0d-a955b97d262f req-5fc3b8ed-e11a-4ca6-b0a0-1f3bb435a947 service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Refreshing instance network info cache due to event network-changed-78f7925f-87b3-4251-90e4-aec51a11e4ec. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7f7600fa-60c7-48ab-9c0d-a955b97d262f req-5fc3b8ed-e11a-4ca6-b0a0-1f3bb435a947 service nova] Acquiring lock "refresh_cache-635717f5-c514-41a7-b9dc-a03d699173c5" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:10:41 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Deleted allocations for instance 32751522-5725-4cb4-a8bd-234dfe84780b
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Received event network-vif-unplugged-24610878-c15b-4646-9dcf-ef49c99ae208 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] Acquiring lock "32751522-5725-4cb4-a8bd-234dfe84780b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] Lock "32751522-5725-4cb4-a8bd-234dfe84780b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] Lock "32751522-5725-4cb4-a8bd-234dfe84780b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] No waiting events found dispatching network-vif-unplugged-24610878-c15b-4646-9dcf-ef49c99ae208 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:10:41 user nova-compute[71692]: WARNING nova.compute.manager [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Received unexpected event network-vif-unplugged-24610878-c15b-4646-9dcf-ef49c99ae208 for instance with vm_state deleted and task_state None.
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Received event network-vif-plugged-24610878-c15b-4646-9dcf-ef49c99ae208 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] Acquiring lock "32751522-5725-4cb4-a8bd-234dfe84780b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] Lock "32751522-5725-4cb4-a8bd-234dfe84780b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] Lock "32751522-5725-4cb4-a8bd-234dfe84780b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] No waiting events found dispatching network-vif-plugged-24610878-c15b-4646-9dcf-ef49c99ae208 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:10:41 user nova-compute[71692]: WARNING nova.compute.manager [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Received unexpected event network-vif-plugged-24610878-c15b-4646-9dcf-ef49c99ae208 for instance with vm_state deleted and task_state None.
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-f6eec2bf-dd83-4daa-8684-1cfc3967dde8 req-08d9f9ee-d6a0-44c9-9a3b-09077eea5c93 service nova] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Received event network-vif-deleted-24610878-c15b-4646-9dcf-ef49c99ae208 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-90b5ccc9-4dd2-4a86-9d1f-1b762676b12e tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "32751522-5725-4cb4-a8bd-234dfe84780b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.945s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.network.neutron [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Updating instance_info_cache with network_info: [{"id": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "address": "fa:16:3e:c5:95:79", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7925f-87", "ovs_interfaceid": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Releasing lock "refresh_cache-635717f5-c514-41a7-b9dc-a03d699173c5" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Instance network_info: |[{"id": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "address": "fa:16:3e:c5:95:79", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7925f-87", "ovs_interfaceid": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7f7600fa-60c7-48ab-9c0d-a955b97d262f req-5fc3b8ed-e11a-4ca6-b0a0-1f3bb435a947 service nova] Acquired lock "refresh_cache-635717f5-c514-41a7-b9dc-a03d699173c5" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.network.neutron [req-7f7600fa-60c7-48ab-9c0d-a955b97d262f req-5fc3b8ed-e11a-4ca6-b0a0-1f3bb435a947 service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Refreshing network info cache for port 78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Start _get_guest_xml network_info=[{"id": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "address": "fa:16:3e:c5:95:79", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7925f-87", "ovs_interfaceid": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:10:41 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:10:41 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:10:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-444502434',display_name='tempest-VolumesActionsTest-instance-444502434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-444502434',id=23,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2877676ccbd0484d80ecabf3030c0ee4',ramdisk_id='',reservation_id='r-8gqzws3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-427747232',owner_user_name='tempest-VolumesActionsTest-427747232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:10:39Z,user_data=None,user_id='80063ed703d24a1b84aede724db205a7',uuid=635717f5-c514-41a7-b9dc-a03d699173c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "address": "fa:16:3e:c5:95:79", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7925f-87", "ovs_interfaceid": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Converting VIF {"id": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "address": "fa:16:3e:c5:95:79", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7925f-87", "ovs_interfaceid": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:95:79,bridge_name='br-int',has_traffic_filtering=True,id=78f7925f-87b3-4251-90e4-aec51a11e4ec,network=Network(b34bf81f-6825-4376-a26c-35386631a4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f7925f-87') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.objects.instance [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lazy-loading 'pci_devices' on Instance uuid 635717f5-c514-41a7-b9dc-a03d699173c5 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:10:41 user nova-compute[71692]:   <uuid>635717f5-c514-41a7-b9dc-a03d699173c5</uuid>
Apr 13 19:10:41 user nova-compute[71692]:   <name>instance-00000017</name>
Apr 13 19:10:41 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:10:41 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:10:41 user nova-compute[71692]:   <metadata>
Apr 13 19:10:41 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:10:41 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:10:41 user nova-compute[71692]:       <nova:name>tempest-VolumesActionsTest-instance-444502434</nova:name>
Apr 13 19:10:41 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:10:41</nova:creationTime>
Apr 13 19:10:41 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:10:41 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:10:41 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:10:41 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:10:41 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:10:41 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:10:41 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:10:41 user nova-compute[71692]:       <nova:owner>
Apr 13 19:10:41 user nova-compute[71692]:         <nova:user uuid="80063ed703d24a1b84aede724db205a7">tempest-VolumesActionsTest-427747232-project-member</nova:user>
Apr 13 19:10:41 user nova-compute[71692]:         <nova:project uuid="2877676ccbd0484d80ecabf3030c0ee4">tempest-VolumesActionsTest-427747232</nova:project>
Apr 13 19:10:41 user nova-compute[71692]:       </nova:owner>
Apr 13 19:10:41 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:10:41 user nova-compute[71692]:       <nova:ports>
Apr 13 19:10:41 user nova-compute[71692]:         <nova:port uuid="78f7925f-87b3-4251-90e4-aec51a11e4ec">
Apr 13 19:10:41 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 19:10:41 user nova-compute[71692]:         </nova:port>
Apr 13 19:10:41 user nova-compute[71692]:       </nova:ports>
Apr 13 19:10:41 user nova-compute[71692]:     </nova:instance>
Apr 13 19:10:41 user nova-compute[71692]:   </metadata>
Apr 13 19:10:41 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:10:41 user nova-compute[71692]:     <system>
Apr 13 19:10:41 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:10:41 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:10:41 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:10:41 user nova-compute[71692]:       <entry name="serial">635717f5-c514-41a7-b9dc-a03d699173c5</entry>
Apr 13 19:10:41 user nova-compute[71692]:       <entry name="uuid">635717f5-c514-41a7-b9dc-a03d699173c5</entry>
Apr 13 19:10:41 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:10:41 user nova-compute[71692]:     </system>
Apr 13 19:10:41 user nova-compute[71692]:   </sysinfo>
Apr 13 19:10:41 user nova-compute[71692]:   <os>
Apr 13 19:10:41 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:10:41 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:10:41 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:10:41 user nova-compute[71692]:   </os>
Apr 13 19:10:41 user nova-compute[71692]:   <features>
Apr 13 19:10:41 user nova-compute[71692]:     <acpi/>
Apr 13 19:10:41 user nova-compute[71692]:     <apic/>
Apr 13 19:10:41 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:10:41 user nova-compute[71692]:   </features>
Apr 13 19:10:41 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:10:41 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:10:41 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:10:41 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:10:41 user nova-compute[71692]:   </clock>
Apr 13 19:10:41 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:10:41 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:10:41 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:10:41 user nova-compute[71692]:   </cpu>
Apr 13 19:10:41 user nova-compute[71692]:   <devices>
Apr 13 19:10:41 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:10:41 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:10:41 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5/disk"/>
Apr 13 19:10:41 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:10:41 user nova-compute[71692]:     </disk>
Apr 13 19:10:41 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:10:41 user nova-compute[71692]:       <mac address="fa:16:3e:c5:95:79"/>
Apr 13 19:10:41 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:10:41 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:10:41 user nova-compute[71692]:       <target dev="tap78f7925f-87"/>
Apr 13 19:10:41 user nova-compute[71692]:     </interface>
Apr 13 19:10:41 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:10:41 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5/console.log" append="off"/>
Apr 13 19:10:41 user nova-compute[71692]:     </serial>
Apr 13 19:10:41 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:10:41 user nova-compute[71692]:     <video>
Apr 13 19:10:41 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:10:41 user nova-compute[71692]:     </video>
Apr 13 19:10:41 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:10:41 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:10:41 user nova-compute[71692]:     </rng>
Apr 13 19:10:41 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:10:41 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:10:41 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:10:41 user nova-compute[71692]:     </memballoon>
Apr 13 19:10:41 user nova-compute[71692]:   </devices>
Apr 13 19:10:41 user nova-compute[71692]: </domain>
Apr 13 19:10:41 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:10:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-444502434',display_name='tempest-VolumesActionsTest-instance-444502434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-444502434',id=23,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2877676ccbd0484d80ecabf3030c0ee4',ramdisk_id='',reservation_id='r-8gqzws3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-427747232',owner_user_name='tempest-VolumesActionsTest-427747232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:10:39Z,user_data=None,user_id='80063ed703d24a1b84aede724db205a7',uuid=635717f5-c514-41a7-b9dc-a03d699173c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "address": "fa:16:3e:c5:95:79", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7925f-87", "ovs_interfaceid": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Converting VIF {"id": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "address": "fa:16:3e:c5:95:79", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7925f-87", "ovs_interfaceid": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:95:79,bridge_name='br-int',has_traffic_filtering=True,id=78f7925f-87b3-4251-90e4-aec51a11e4ec,network=Network(b34bf81f-6825-4376-a26c-35386631a4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f7925f-87') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG os_vif [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:95:79,bridge_name='br-int',has_traffic_filtering=True,id=78f7925f-87b3-4251-90e4-aec51a11e4ec,network=Network(b34bf81f-6825-4376-a26c-35386631a4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f7925f-87') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78f7925f-87, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap78f7925f-87, col_values=(('external_ids', {'iface-id': '78f7925f-87b3-4251-90e4-aec51a11e4ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:95:79', 'vm-uuid': '635717f5-c514-41a7-b9dc-a03d699173c5'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:41 user nova-compute[71692]: INFO os_vif [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:95:79,bridge_name='br-int',has_traffic_filtering=True,id=78f7925f-87b3-4251-90e4-aec51a11e4ec,network=Network(b34bf81f-6825-4376-a26c-35386631a4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f7925f-87')
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] No VIF found with MAC fa:16:3e:c5:95:79, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.network.neutron [req-7f7600fa-60c7-48ab-9c0d-a955b97d262f req-5fc3b8ed-e11a-4ca6-b0a0-1f3bb435a947 service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Updated VIF entry in instance network info cache for port 78f7925f-87b3-4251-90e4-aec51a11e4ec. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG nova.network.neutron [req-7f7600fa-60c7-48ab-9c0d-a955b97d262f req-5fc3b8ed-e11a-4ca6-b0a0-1f3bb435a947 service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Updating instance_info_cache with network_info: [{"id": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "address": "fa:16:3e:c5:95:79", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7925f-87", "ovs_interfaceid": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:10:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7f7600fa-60c7-48ab-9c0d-a955b97d262f req-5fc3b8ed-e11a-4ca6-b0a0-1f3bb435a947 service nova] Releasing lock "refresh_cache-635717f5-c514-41a7-b9dc-a03d699173c5" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:10:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-a3f334b2-dad1-449c-95de-799f4831d74a req-dcdd6612-a1aa-439e-9fcc-f55b642e6b14 service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Received event network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a3f334b2-dad1-449c-95de-799f4831d74a req-dcdd6612-a1aa-439e-9fcc-f55b642e6b14 service nova] Acquiring lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a3f334b2-dad1-449c-95de-799f4831d74a req-dcdd6612-a1aa-439e-9fcc-f55b642e6b14 service nova] Lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a3f334b2-dad1-449c-95de-799f4831d74a req-dcdd6612-a1aa-439e-9fcc-f55b642e6b14 service nova] Lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-a3f334b2-dad1-449c-95de-799f4831d74a req-dcdd6612-a1aa-439e-9fcc-f55b642e6b14 service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] No waiting events found dispatching network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:10:43 user nova-compute[71692]: WARNING nova.compute.manager [req-a3f334b2-dad1-449c-95de-799f4831d74a req-dcdd6612-a1aa-439e-9fcc-f55b642e6b14 service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Received unexpected event network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec for instance with vm_state building and task_state spawning.
Apr 13 19:10:43 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:10:43 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:10:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8227MB free_disk=26.131855010986328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 59d7b86a-c723-4255-827e-2f6a641239df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance cb3fb753-ff8d-4dac-ab70-f940233bf25d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 33367b19-4d62-46dc-8346-45ea09c5563d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 635717f5-c514-41a7-b9dc-a03d699173c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:10:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:44 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:10:44 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413045.1249588, 635717f5-c514-41a7-b9dc-a03d699173c5 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:10:45 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] VM Resumed (Lifecycle Event)
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:10:45 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Instance spawned successfully.
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:10:45 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413045.12846, 635717f5-c514-41a7-b9dc-a03d699173c5 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:10:45 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] VM Started (Lifecycle Event)
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:10:45 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:10:45 user nova-compute[71692]: INFO nova.compute.manager [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Took 6.15 seconds to spawn the instance on the hypervisor.
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.compute.manager [req-aa1d9dc6-4ca4-4e54-a9ad-d7089ec1e966 req-336c9a13-c1f9-49af-9a2f-5e64a5a147a2 service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Received event network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:10:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-aa1d9dc6-4ca4-4e54-a9ad-d7089ec1e966 req-336c9a13-c1f9-49af-9a2f-5e64a5a147a2 service nova] Acquiring lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-aa1d9dc6-4ca4-4e54-a9ad-d7089ec1e966 req-336c9a13-c1f9-49af-9a2f-5e64a5a147a2 service nova] Lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-aa1d9dc6-4ca4-4e54-a9ad-d7089ec1e966 req-336c9a13-c1f9-49af-9a2f-5e64a5a147a2 service nova] Lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:45 user nova-compute[71692]: DEBUG nova.compute.manager [req-aa1d9dc6-4ca4-4e54-a9ad-d7089ec1e966 req-336c9a13-c1f9-49af-9a2f-5e64a5a147a2 service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] No waiting events found dispatching network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:10:45 user nova-compute[71692]: WARNING nova.compute.manager [req-aa1d9dc6-4ca4-4e54-a9ad-d7089ec1e966 req-336c9a13-c1f9-49af-9a2f-5e64a5a147a2 service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Received unexpected event network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec for instance with vm_state building and task_state spawning.
Apr 13 19:10:45 user nova-compute[71692]: INFO nova.compute.manager [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Took 6.85 seconds to build instance.
Apr 13 19:10:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8715229b-ed58-4cca-a936-a0188b8c7928 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "635717f5-c514-41a7-b9dc-a03d699173c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.950s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:54 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413039.996208, 32751522-5725-4cb4-a8bd-234dfe84780b => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:10:55 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] VM Stopped (Lifecycle Event)
Apr 13 19:10:55 user nova-compute[71692]: DEBUG nova.compute.manager [None req-fc8caa90-d4c2-41dc-b252-521edf9b4df7 None None] [instance: 32751522-5725-4cb4-a8bd-234dfe84780b] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:10:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:10:58 user nova-compute[71692]: INFO nova.compute.claims [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Claim successful on node user
Apr 13 19:10:58 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:10:58 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:10:58 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG nova.policy [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '975d5fe9f1e445f0ba1be8fc71e93ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc458426af4ea2b4bbcfdf9b4fe041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:10:58 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Creating image(s)
Apr 13 19:10:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "/opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "/opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk 1073741824" returned: 0 in 0.047s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:59 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:10:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:10:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:10:59 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Cannot resize image /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:10:59 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'migration_context' on Instance uuid ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:10:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:10:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Ensure instance console log exists: /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:10:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:10:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:10:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:10:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Successfully created port: e124e179-0315-423a-b9cf-c232753845ed {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Successfully updated port: e124e179-0315-423a-b9cf-c232753845ed {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "refresh_cache-ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquired lock "refresh_cache-ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-8a522d36-865a-4783-869f-ba47c65317b2 req-e033ccad-8260-4800-8a95-7a965ea86b5d service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Received event network-changed-e124e179-0315-423a-b9cf-c232753845ed {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-8a522d36-865a-4783-869f-ba47c65317b2 req-e033ccad-8260-4800-8a95-7a965ea86b5d service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Refreshing instance network info cache due to event network-changed-e124e179-0315-423a-b9cf-c232753845ed. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8a522d36-865a-4783-869f-ba47c65317b2 req-e033ccad-8260-4800-8a95-7a965ea86b5d service nova] Acquiring lock "refresh_cache-ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Updating instance_info_cache with network_info: [{"id": "e124e179-0315-423a-b9cf-c232753845ed", "address": "fa:16:3e:1a:cf:e4", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape124e179-03", "ovs_interfaceid": "e124e179-0315-423a-b9cf-c232753845ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Releasing lock "refresh_cache-ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Instance network_info: |[{"id": "e124e179-0315-423a-b9cf-c232753845ed", "address": "fa:16:3e:1a:cf:e4", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape124e179-03", "ovs_interfaceid": "e124e179-0315-423a-b9cf-c232753845ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8a522d36-865a-4783-869f-ba47c65317b2 req-e033ccad-8260-4800-8a95-7a965ea86b5d service nova] Acquired lock "refresh_cache-ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.network.neutron [req-8a522d36-865a-4783-869f-ba47c65317b2 req-e033ccad-8260-4800-8a95-7a965ea86b5d service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Refreshing network info cache for port e124e179-0315-423a-b9cf-c232753845ed {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Start _get_guest_xml network_info=[{"id": "e124e179-0315-423a-b9cf-c232753845ed", "address": "fa:16:3e:1a:cf:e4", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape124e179-03", "ovs_interfaceid": "e124e179-0315-423a-b9cf-c232753845ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:11:00 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:11:00 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2113721344',display_name='tempest-AttachVolumeNegativeTest-server-2113721344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2113721344',id=24,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKdS7h4tFyxpAMeYLQuh8ih425eVCG7EZMy8h5k1UPuzrtZ/SoBsVJTEzpMJsvBkj1pJCZh3INmXLgWHuWn9olcGY7rfHpFr8uXlLrmR2vq4y76F919hEdaBpypdO4nAA==',key_name='tempest-keypair-1344017995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dcc458426af4ea2b4bbcfdf9b4fe041',ramdisk_id='',reservation_id='r-lzpleslk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-513091417',owner_user_name='tempest-AttachVolumeNegativeTest-513091417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975d5fe9f1e445f0ba1be8fc71e93ecc',uuid=ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e124e179-0315-423a-b9cf-c232753845ed", "address": "fa:16:3e:1a:cf:e4", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape124e179-03", "ovs_interfaceid": "e124e179-0315-423a-b9cf-c232753845ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converting VIF {"id": "e124e179-0315-423a-b9cf-c232753845ed", "address": "fa:16:3e:1a:cf:e4", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape124e179-03", "ovs_interfaceid": "e124e179-0315-423a-b9cf-c232753845ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:cf:e4,bridge_name='br-int',has_traffic_filtering=True,id=e124e179-0315-423a-b9cf-c232753845ed,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape124e179-03') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'pci_devices' on Instance uuid ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:11:00 user nova-compute[71692]:   <uuid>ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d</uuid>
Apr 13 19:11:00 user nova-compute[71692]:   <name>instance-00000018</name>
Apr 13 19:11:00 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:11:00 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:11:00 user nova-compute[71692]:   <metadata>
Apr 13 19:11:00 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:11:00 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:11:00 user nova-compute[71692]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2113721344</nova:name>
Apr 13 19:11:00 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:11:00</nova:creationTime>
Apr 13 19:11:00 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:11:00 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:11:00 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:11:00 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:11:00 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:11:00 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:11:00 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:11:00 user nova-compute[71692]:       <nova:owner>
Apr 13 19:11:00 user nova-compute[71692]:         <nova:user uuid="975d5fe9f1e445f0ba1be8fc71e93ecc">tempest-AttachVolumeNegativeTest-513091417-project-member</nova:user>
Apr 13 19:11:00 user nova-compute[71692]:         <nova:project uuid="0dcc458426af4ea2b4bbcfdf9b4fe041">tempest-AttachVolumeNegativeTest-513091417</nova:project>
Apr 13 19:11:00 user nova-compute[71692]:       </nova:owner>
Apr 13 19:11:00 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:11:00 user nova-compute[71692]:       <nova:ports>
Apr 13 19:11:00 user nova-compute[71692]:         <nova:port uuid="e124e179-0315-423a-b9cf-c232753845ed">
Apr 13 19:11:00 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 19:11:00 user nova-compute[71692]:         </nova:port>
Apr 13 19:11:00 user nova-compute[71692]:       </nova:ports>
Apr 13 19:11:00 user nova-compute[71692]:     </nova:instance>
Apr 13 19:11:00 user nova-compute[71692]:   </metadata>
Apr 13 19:11:00 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:11:00 user nova-compute[71692]:     <system>
Apr 13 19:11:00 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:11:00 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:11:00 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:11:00 user nova-compute[71692]:       <entry name="serial">ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d</entry>
Apr 13 19:11:00 user nova-compute[71692]:       <entry name="uuid">ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d</entry>
Apr 13 19:11:00 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:11:00 user nova-compute[71692]:     </system>
Apr 13 19:11:00 user nova-compute[71692]:   </sysinfo>
Apr 13 19:11:00 user nova-compute[71692]:   <os>
Apr 13 19:11:00 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:11:00 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:11:00 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:11:00 user nova-compute[71692]:   </os>
Apr 13 19:11:00 user nova-compute[71692]:   <features>
Apr 13 19:11:00 user nova-compute[71692]:     <acpi/>
Apr 13 19:11:00 user nova-compute[71692]:     <apic/>
Apr 13 19:11:00 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:11:00 user nova-compute[71692]:   </features>
Apr 13 19:11:00 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:11:00 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:11:00 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:11:00 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:11:00 user nova-compute[71692]:   </clock>
Apr 13 19:11:00 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:11:00 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:11:00 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:11:00 user nova-compute[71692]:   </cpu>
Apr 13 19:11:00 user nova-compute[71692]:   <devices>
Apr 13 19:11:00 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:11:00 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:11:00 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk"/>
Apr 13 19:11:00 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:11:00 user nova-compute[71692]:     </disk>
Apr 13 19:11:00 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:11:00 user nova-compute[71692]:       <mac address="fa:16:3e:1a:cf:e4"/>
Apr 13 19:11:00 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:11:00 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:11:00 user nova-compute[71692]:       <target dev="tape124e179-03"/>
Apr 13 19:11:00 user nova-compute[71692]:     </interface>
Apr 13 19:11:00 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:11:00 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/console.log" append="off"/>
Apr 13 19:11:00 user nova-compute[71692]:     </serial>
Apr 13 19:11:00 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:11:00 user nova-compute[71692]:     <video>
Apr 13 19:11:00 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:11:00 user nova-compute[71692]:     </video>
Apr 13 19:11:00 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:11:00 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:11:00 user nova-compute[71692]:     </rng>
Apr 13 19:11:00 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:11:00 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:11:00 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:11:00 user nova-compute[71692]:     </memballoon>
Apr 13 19:11:00 user nova-compute[71692]:   </devices>
Apr 13 19:11:00 user nova-compute[71692]: </domain>
Apr 13 19:11:00 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2113721344',display_name='tempest-AttachVolumeNegativeTest-server-2113721344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2113721344',id=24,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKdS7h4tFyxpAMeYLQuh8ih425eVCG7EZMy8h5k1UPuzrtZ/SoBsVJTEzpMJsvBkj1pJCZh3INmXLgWHuWn9olcGY7rfHpFr8uXlLrmR2vq4y76F919hEdaBpypdO4nAA==',key_name='tempest-keypair-1344017995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dcc458426af4ea2b4bbcfdf9b4fe041',ramdisk_id='',reservation_id='r-lzpleslk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-513091417',owner_user_name='tempest-AttachVolumeNegativeTest-513091417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975d5fe9f1e445f0ba1be8fc71e93ecc',uuid=ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e124e179-0315-423a-b9cf-c232753845ed", "address": "fa:16:3e:1a:cf:e4", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape124e179-03", "ovs_interfaceid": "e124e179-0315-423a-b9cf-c232753845ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converting VIF {"id": "e124e179-0315-423a-b9cf-c232753845ed", "address": "fa:16:3e:1a:cf:e4", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape124e179-03", "ovs_interfaceid": "e124e179-0315-423a-b9cf-c232753845ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:cf:e4,bridge_name='br-int',has_traffic_filtering=True,id=e124e179-0315-423a-b9cf-c232753845ed,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape124e179-03') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG os_vif [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:cf:e4,bridge_name='br-int',has_traffic_filtering=True,id=e124e179-0315-423a-b9cf-c232753845ed,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape124e179-03') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape124e179-03, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape124e179-03, col_values=(('external_ids', {'iface-id': 'e124e179-0315-423a-b9cf-c232753845ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:cf:e4', 'vm-uuid': 'ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:00 user nova-compute[71692]: INFO os_vif [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:cf:e4,bridge_name='br-int',has_traffic_filtering=True,id=e124e179-0315-423a-b9cf-c232753845ed,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape124e179-03')
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:11:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] No VIF found with MAC fa:16:3e:1a:cf:e4, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:11:01 user nova-compute[71692]: DEBUG nova.network.neutron [req-8a522d36-865a-4783-869f-ba47c65317b2 req-e033ccad-8260-4800-8a95-7a965ea86b5d service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Updated VIF entry in instance network info cache for port e124e179-0315-423a-b9cf-c232753845ed. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:11:01 user nova-compute[71692]: DEBUG nova.network.neutron [req-8a522d36-865a-4783-869f-ba47c65317b2 req-e033ccad-8260-4800-8a95-7a965ea86b5d service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Updating instance_info_cache with network_info: [{"id": "e124e179-0315-423a-b9cf-c232753845ed", "address": "fa:16:3e:1a:cf:e4", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape124e179-03", "ovs_interfaceid": "e124e179-0315-423a-b9cf-c232753845ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:11:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8a522d36-865a-4783-869f-ba47c65317b2 req-e033ccad-8260-4800-8a95-7a965ea86b5d service nova] Releasing lock "refresh_cache-ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:11:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:02 user nova-compute[71692]: DEBUG nova.compute.manager [req-127e3259-8aad-46e3-924d-e0a498c21367 req-4f27db26-c6b3-49ae-b2bb-c009d8c6a04e service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Received event network-vif-plugged-e124e179-0315-423a-b9cf-c232753845ed {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:11:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-127e3259-8aad-46e3-924d-e0a498c21367 req-4f27db26-c6b3-49ae-b2bb-c009d8c6a04e service nova] Acquiring lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-127e3259-8aad-46e3-924d-e0a498c21367 req-4f27db26-c6b3-49ae-b2bb-c009d8c6a04e service nova] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-127e3259-8aad-46e3-924d-e0a498c21367 req-4f27db26-c6b3-49ae-b2bb-c009d8c6a04e service nova] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:02 user nova-compute[71692]: DEBUG nova.compute.manager [req-127e3259-8aad-46e3-924d-e0a498c21367 req-4f27db26-c6b3-49ae-b2bb-c009d8c6a04e service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] No waiting events found dispatching network-vif-plugged-e124e179-0315-423a-b9cf-c232753845ed {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:11:02 user nova-compute[71692]: WARNING nova.compute.manager [req-127e3259-8aad-46e3-924d-e0a498c21367 req-4f27db26-c6b3-49ae-b2bb-c009d8c6a04e service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Received unexpected event network-vif-plugged-e124e179-0315-423a-b9cf-c232753845ed for instance with vm_state building and task_state spawning.
Apr 13 19:11:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413064.23466, ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:11:04 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] VM Resumed (Lifecycle Event)
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:11:04 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Instance spawned successfully.
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:11:04 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413064.2382164, ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:11:04 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] VM Started (Lifecycle Event)
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:11:04 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:11:04 user nova-compute[71692]: INFO nova.compute.manager [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Took 5.52 seconds to spawn the instance on the hypervisor.
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:11:04 user nova-compute[71692]: INFO nova.compute.manager [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Took 6.10 seconds to build instance.
Apr 13 19:11:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a9b384-0cef-4d31-a993-d4d3f874709c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.193s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-78d432e7-b909-44da-8669-ace96c5dcaf0 req-92aa8d61-68fc-4397-a3b0-0303407e830e service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Received event network-vif-plugged-e124e179-0315-423a-b9cf-c232753845ed {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:11:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-78d432e7-b909-44da-8669-ace96c5dcaf0 req-92aa8d61-68fc-4397-a3b0-0303407e830e service nova] Acquiring lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-78d432e7-b909-44da-8669-ace96c5dcaf0 req-92aa8d61-68fc-4397-a3b0-0303407e830e service nova] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-78d432e7-b909-44da-8669-ace96c5dcaf0 req-92aa8d61-68fc-4397-a3b0-0303407e830e service nova] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-78d432e7-b909-44da-8669-ace96c5dcaf0 req-92aa8d61-68fc-4397-a3b0-0303407e830e service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] No waiting events found dispatching network-vif-plugged-e124e179-0315-423a-b9cf-c232753845ed {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:11:04 user nova-compute[71692]: WARNING nova.compute.manager [req-78d432e7-b909-44da-8669-ace96c5dcaf0 req-92aa8d61-68fc-4397-a3b0-0303407e830e service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Received unexpected event network-vif-plugged-e124e179-0315-423a-b9cf-c232753845ed for instance with vm_state active and task_state None.
Apr 13 19:11:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:06 user nova-compute[71692]: INFO nova.compute.manager [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Unshelving
Apr 13 19:11:06 user nova-compute[71692]: INFO nova.virt.block_device [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Booting with volume c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 at /dev/vda
Apr 13 19:11:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG os_brick.utils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede65d5b-7b14-4dab-89cf-b3b3434e2773]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c274bb48-22f7-4148-885c-a18bf1f9306f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[433d1245-9318-4834-aa87-2379dcdf3e05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[365543ef-a75c-4050-9ef0-8c2c7fe4a138]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:11:06 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:11:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fba0bf6-85b5-4e4b-a779-eeea51a779ab]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG os_brick.utils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:11:06 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updating existing volume attachment record: 82156fad-7cb2-4808-ad81-bbfc7b9bd05e {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:11:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "579c83e7-7976-47f4-9f25-a194e39966ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "579c83e7-7976-47f4-9f25-a194e39966ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:11:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:08 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:11:08 user nova-compute[71692]: INFO nova.compute.claims [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Claim successful on node user
Apr 13 19:11:09 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG nova.compute.manager [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG nova.compute.manager [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG nova.network.neutron [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:11:09 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:11:09 user nova-compute[71692]: DEBUG nova.compute.manager [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG nova.compute.manager [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:11:09 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Creating image(s)
Apr 13 19:11:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "/opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "/opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "/opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG nova.policy [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.162s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk 1073741824" returned: 0 in 0.047s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Checking if we can resize image /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Cannot resize image /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:11:09 user nova-compute[71692]: DEBUG nova.objects.instance [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'migration_context' on Instance uuid 579c83e7-7976-47f4-9f25-a194e39966ba {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:11:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:11:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Ensure instance console log exists: /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:11:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:10 user nova-compute[71692]: DEBUG nova.network.neutron [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Successfully created port: ab959649-556a-479c-9e13-ec36fb9ebb66 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:11:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:10 user nova-compute[71692]: DEBUG nova.network.neutron [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Successfully updated port: ab959649-556a-479c-9e13-ec36fb9ebb66 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:11:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:11:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquired lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:11:10 user nova-compute[71692]: DEBUG nova.network.neutron [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:11:10 user nova-compute[71692]: DEBUG nova.compute.manager [req-4efec86e-94bb-49e2-9bdf-575241812ef7 req-8f3afccb-8d31-48d1-8594-c07d630ef505 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Received event network-changed-ab959649-556a-479c-9e13-ec36fb9ebb66 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:11:10 user nova-compute[71692]: DEBUG nova.compute.manager [req-4efec86e-94bb-49e2-9bdf-575241812ef7 req-8f3afccb-8d31-48d1-8594-c07d630ef505 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Refreshing instance network info cache due to event network-changed-ab959649-556a-479c-9e13-ec36fb9ebb66. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:11:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4efec86e-94bb-49e2-9bdf-575241812ef7 req-8f3afccb-8d31-48d1-8594-c07d630ef505 service nova] Acquiring lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:11:10 user nova-compute[71692]: DEBUG nova.network.neutron [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.network.neutron [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Updating instance_info_cache with network_info: [{"id": "ab959649-556a-479c-9e13-ec36fb9ebb66", "address": "fa:16:3e:4b:6d:5f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab959649-55", "ovs_interfaceid": "ab959649-556a-479c-9e13-ec36fb9ebb66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Releasing lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Instance network_info: |[{"id": "ab959649-556a-479c-9e13-ec36fb9ebb66", "address": "fa:16:3e:4b:6d:5f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab959649-55", "ovs_interfaceid": "ab959649-556a-479c-9e13-ec36fb9ebb66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4efec86e-94bb-49e2-9bdf-575241812ef7 req-8f3afccb-8d31-48d1-8594-c07d630ef505 service nova] Acquired lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.network.neutron [req-4efec86e-94bb-49e2-9bdf-575241812ef7 req-8f3afccb-8d31-48d1-8594-c07d630ef505 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Refreshing network info cache for port ab959649-556a-479c-9e13-ec36fb9ebb66 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Start _get_guest_xml network_info=[{"id": "ab959649-556a-479c-9e13-ec36fb9ebb66", "address": "fa:16:3e:4b:6d:5f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab959649-55", "ovs_interfaceid": "ab959649-556a-479c-9e13-ec36fb9ebb66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:11:11 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:11:11 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-624786944',display_name='tempest-ServerActionsTestJSON-server-624786944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-624786944',id=25,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-b0w0cukh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=579c83e7-7976-47f4-9f25-a194e39966ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab959649-556a-479c-9e13-ec36fb9ebb66", "address": "fa:16:3e:4b:6d:5f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab959649-55", "ovs_interfaceid": "ab959649-556a-479c-9e13-ec36fb9ebb66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "ab959649-556a-479c-9e13-ec36fb9ebb66", "address": "fa:16:3e:4b:6d:5f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab959649-55", "ovs_interfaceid": "ab959649-556a-479c-9e13-ec36fb9ebb66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6d:5f,bridge_name='br-int',has_traffic_filtering=True,id=ab959649-556a-479c-9e13-ec36fb9ebb66,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab959649-55') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.objects.instance [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'pci_devices' on Instance uuid 579c83e7-7976-47f4-9f25-a194e39966ba {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:11:11 user nova-compute[71692]:   <uuid>579c83e7-7976-47f4-9f25-a194e39966ba</uuid>
Apr 13 19:11:11 user nova-compute[71692]:   <name>instance-00000019</name>
Apr 13 19:11:11 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:11:11 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:11:11 user nova-compute[71692]:   <metadata>
Apr 13 19:11:11 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:11:11 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:11:11 user nova-compute[71692]:       <nova:name>tempest-ServerActionsTestJSON-server-624786944</nova:name>
Apr 13 19:11:11 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:11:11</nova:creationTime>
Apr 13 19:11:11 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:11:11 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:11:11 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:11:11 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:11:11 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:11:11 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:11:11 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:11:11 user nova-compute[71692]:       <nova:owner>
Apr 13 19:11:11 user nova-compute[71692]:         <nova:user uuid="df209814208d415e9d414d39205aaad6">tempest-ServerActionsTestJSON-1901931474-project-member</nova:user>
Apr 13 19:11:11 user nova-compute[71692]:         <nova:project uuid="c162f91cba4b4ecf9de48fbf839da261">tempest-ServerActionsTestJSON-1901931474</nova:project>
Apr 13 19:11:11 user nova-compute[71692]:       </nova:owner>
Apr 13 19:11:11 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:11:11 user nova-compute[71692]:       <nova:ports>
Apr 13 19:11:11 user nova-compute[71692]:         <nova:port uuid="ab959649-556a-479c-9e13-ec36fb9ebb66">
Apr 13 19:11:11 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 19:11:11 user nova-compute[71692]:         </nova:port>
Apr 13 19:11:11 user nova-compute[71692]:       </nova:ports>
Apr 13 19:11:11 user nova-compute[71692]:     </nova:instance>
Apr 13 19:11:11 user nova-compute[71692]:   </metadata>
Apr 13 19:11:11 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:11:11 user nova-compute[71692]:     <system>
Apr 13 19:11:11 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:11:11 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:11:11 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:11:11 user nova-compute[71692]:       <entry name="serial">579c83e7-7976-47f4-9f25-a194e39966ba</entry>
Apr 13 19:11:11 user nova-compute[71692]:       <entry name="uuid">579c83e7-7976-47f4-9f25-a194e39966ba</entry>
Apr 13 19:11:11 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:11:11 user nova-compute[71692]:     </system>
Apr 13 19:11:11 user nova-compute[71692]:   </sysinfo>
Apr 13 19:11:11 user nova-compute[71692]:   <os>
Apr 13 19:11:11 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:11:11 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:11:11 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:11:11 user nova-compute[71692]:   </os>
Apr 13 19:11:11 user nova-compute[71692]:   <features>
Apr 13 19:11:11 user nova-compute[71692]:     <acpi/>
Apr 13 19:11:11 user nova-compute[71692]:     <apic/>
Apr 13 19:11:11 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:11:11 user nova-compute[71692]:   </features>
Apr 13 19:11:11 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:11:11 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:11:11 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:11:11 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:11:11 user nova-compute[71692]:   </clock>
Apr 13 19:11:11 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:11:11 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:11:11 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:11:11 user nova-compute[71692]:   </cpu>
Apr 13 19:11:11 user nova-compute[71692]:   <devices>
Apr 13 19:11:11 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:11:11 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:11:11 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk"/>
Apr 13 19:11:11 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:11:11 user nova-compute[71692]:     </disk>
Apr 13 19:11:11 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:11:11 user nova-compute[71692]:       <mac address="fa:16:3e:4b:6d:5f"/>
Apr 13 19:11:11 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:11:11 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:11:11 user nova-compute[71692]:       <target dev="tapab959649-55"/>
Apr 13 19:11:11 user nova-compute[71692]:     </interface>
Apr 13 19:11:11 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:11:11 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/console.log" append="off"/>
Apr 13 19:11:11 user nova-compute[71692]:     </serial>
Apr 13 19:11:11 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:11:11 user nova-compute[71692]:     <video>
Apr 13 19:11:11 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:11:11 user nova-compute[71692]:     </video>
Apr 13 19:11:11 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:11:11 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:11:11 user nova-compute[71692]:     </rng>
Apr 13 19:11:11 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:11:11 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:11:11 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:11:11 user nova-compute[71692]:     </memballoon>
Apr 13 19:11:11 user nova-compute[71692]:   </devices>
Apr 13 19:11:11 user nova-compute[71692]: </domain>
Apr 13 19:11:11 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-624786944',display_name='tempest-ServerActionsTestJSON-server-624786944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-624786944',id=25,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-b0w0cukh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=579c83e7-7976-47f4-9f25-a194e39966ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab959649-556a-479c-9e13-ec36fb9ebb66", "address": "fa:16:3e:4b:6d:5f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab959649-55", "ovs_interfaceid": "ab959649-556a-479c-9e13-ec36fb9ebb66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "ab959649-556a-479c-9e13-ec36fb9ebb66", "address": "fa:16:3e:4b:6d:5f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab959649-55", "ovs_interfaceid": "ab959649-556a-479c-9e13-ec36fb9ebb66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6d:5f,bridge_name='br-int',has_traffic_filtering=True,id=ab959649-556a-479c-9e13-ec36fb9ebb66,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab959649-55') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG os_vif [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6d:5f,bridge_name='br-int',has_traffic_filtering=True,id=ab959649-556a-479c-9e13-ec36fb9ebb66,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab959649-55') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab959649-55, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapab959649-55, col_values=(('external_ids', {'iface-id': 'ab959649-556a-479c-9e13-ec36fb9ebb66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:6d:5f', 'vm-uuid': '579c83e7-7976-47f4-9f25-a194e39966ba'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:11 user nova-compute[71692]: INFO os_vif [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6d:5f,bridge_name='br-int',has_traffic_filtering=True,id=ab959649-556a-479c-9e13-ec36fb9ebb66,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab959649-55')
Apr 13 19:11:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.objects.instance [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lazy-loading 'pci_requests' on Instance uuid 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.objects.instance [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lazy-loading 'numa_topology' on Instance uuid 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:11:11 user nova-compute[71692]: INFO nova.compute.claims [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Claim successful on node user
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No VIF found with MAC fa:16:3e:4b:6d:5f, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.network.neutron [req-4efec86e-94bb-49e2-9bdf-575241812ef7 req-8f3afccb-8d31-48d1-8594-c07d630ef505 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Updated VIF entry in instance network info cache for port ab959649-556a-479c-9e13-ec36fb9ebb66. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.network.neutron [req-4efec86e-94bb-49e2-9bdf-575241812ef7 req-8f3afccb-8d31-48d1-8594-c07d630ef505 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Updating instance_info_cache with network_info: [{"id": "ab959649-556a-479c-9e13-ec36fb9ebb66", "address": "fa:16:3e:4b:6d:5f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab959649-55", "ovs_interfaceid": "ab959649-556a-479c-9e13-ec36fb9ebb66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4efec86e-94bb-49e2-9bdf-575241812ef7 req-8f3afccb-8d31-48d1-8594-c07d630ef505 service nova] Releasing lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:11:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:11 user nova-compute[71692]: INFO nova.network.neutron [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updating port 8640b481-7480-494b-a88b-e21419d695cf with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 19:11:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:11:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquired lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:11:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:11:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-6a53b3b7-3300-4c62-afeb-588d5c8e6a50 req-3a7d72a7-5606-4666-82e1-859a30df2327 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received event network-changed-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:11:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-6a53b3b7-3300-4c62-afeb-588d5c8e6a50 req-3a7d72a7-5606-4666-82e1-859a30df2327 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Refreshing instance network info cache due to event network-changed-8640b481-7480-494b-a88b-e21419d695cf. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:11:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6a53b3b7-3300-4c62-afeb-588d5c8e6a50 req-3a7d72a7-5606-4666-82e1-859a30df2327 service nova] Acquiring lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-3e448b24-9fb5-4534-ad3d-db2f0ee4c8a0 req-e8024cec-fdad-4a19-8958-473fdf424f35 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Received event network-vif-plugged-ab959649-556a-479c-9e13-ec36fb9ebb66 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3e448b24-9fb5-4534-ad3d-db2f0ee4c8a0 req-e8024cec-fdad-4a19-8958-473fdf424f35 service nova] Acquiring lock "579c83e7-7976-47f4-9f25-a194e39966ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3e448b24-9fb5-4534-ad3d-db2f0ee4c8a0 req-e8024cec-fdad-4a19-8958-473fdf424f35 service nova] Lock "579c83e7-7976-47f4-9f25-a194e39966ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3e448b24-9fb5-4534-ad3d-db2f0ee4c8a0 req-e8024cec-fdad-4a19-8958-473fdf424f35 service nova] Lock "579c83e7-7976-47f4-9f25-a194e39966ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-3e448b24-9fb5-4534-ad3d-db2f0ee4c8a0 req-e8024cec-fdad-4a19-8958-473fdf424f35 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] No waiting events found dispatching network-vif-plugged-ab959649-556a-479c-9e13-ec36fb9ebb66 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:11:13 user nova-compute[71692]: WARNING nova.compute.manager [req-3e448b24-9fb5-4534-ad3d-db2f0ee4c8a0 req-e8024cec-fdad-4a19-8958-473fdf424f35 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Received unexpected event network-vif-plugged-ab959649-556a-479c-9e13-ec36fb9ebb66 for instance with vm_state building and task_state spawning.
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.network.neutron [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updating instance_info_cache with network_info: [{"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Releasing lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:11:13 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Creating image(s)
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Did not create local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Ensure instance console log exists: /opt/stack/data/nova/instances/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Start _get_guest_xml network_info=[{"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '82156fad-7cb2-4808-ad81-bbfc7b9bd05e', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NeMxmspT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c60e6c0-533c-4fd3-938f-b9ecc9fb0333', 'attached_at': '', 'detached_at': '', 'volume_id': 'c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96', 'serial': 'c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6a53b3b7-3300-4c62-afeb-588d5c8e6a50 req-3a7d72a7-5606-4666-82e1-859a30df2327 service nova] Acquired lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.network.neutron [req-6a53b3b7-3300-4c62-afeb-588d5c8e6a50 req-3a7d72a7-5606-4666-82e1-859a30df2327 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Refreshing network info cache for port 8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:13 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:11:13 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.objects.instance [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NeMxmspT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:11:13 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:11:13 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:11:13 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d001486-f150-4895-ad73-beaab011cf5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:11:13 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5bdcce-7e0a-4e11-8d74-d6453a8112c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96] added
Apr 13 19:11:13 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[92405d15-fe7d-449e-9378-c9fdb93b1609]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8720e10-5104-4c8a-adea-6f76d8cc8d6d]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NeMxmspT {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NeMxmspT" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dcccf6-86f9-4ff9-bafa-02d71fb61c2a]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NeMxmspT'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3eb329-e6a4-4ae2-92c6-0b6df6b7b6c7]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d58d85a-3fbe-4608-b351-092ab55ed26d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 19:11:13 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 19:11:13 user nova-compute[71692]:  {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:11:13 user nova-compute[71692]: WARNING os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 19:11:13 user nova-compute[71692]: 
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95d7bb1-7646-44cd-b07c-acfea51fc674]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96, portal: 172.16.0.220,3260]
Apr 13 19:11:13 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96, portal: 172.16.0.220,3260] successful.
Apr 13 19:11:13 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[36deb9d0-9425-4d4a-935b-98990c9b83f1]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ce10b9-7ee0-47c8-86d1-80b34208fdde]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:11:13 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:11:13 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0426435e-49cf-4f16-a704-92923281c181]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NeMxmspT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.network.neutron [req-6a53b3b7-3300-4c62-afeb-588d5c8e6a50 req-3a7d72a7-5606-4666-82e1-859a30df2327 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updated VIF entry in instance network info cache for port 8640b481-7480-494b-a88b-e21419d695cf. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG nova.network.neutron [req-6a53b3b7-3300-4c62-afeb-588d5c8e6a50 req-3a7d72a7-5606-4666-82e1-859a30df2327 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updating instance_info_cache with network_info: [{"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:11:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6a53b3b7-3300-4c62-afeb-588d5c8e6a50 req-3a7d72a7-5606-4666-82e1-859a30df2327 service nova] Releasing lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23633643935386534', 'path': '/dev/sdb'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633643935386534', 'path': '/dev/sdb'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T19:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-83408209',display_name='tempest-TestShelveInstance-server-83408209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-83408209',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-24428880',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:07:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='20b8fe614f0541009788ffe685720634',ramdisk_id='',reservation_id='r-p03apkpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1512441304',owner_user_name='tempest-TestShelveInstance-1512441304-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:11:06Z,user_data=None,user_id='e44f04fabef14935a4617dd452d3999b',uuid=8c60e6c0-533c-4fd3-938f-b9ecc9fb0333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Converting VIF {"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e5:46,bridge_name='br-int',has_traffic_filtering=True,id=8640b481-7480-494b-a88b-e21419d695cf,network=Network(caba0c3f-498e-458e-86ba-f7a0a147a7d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8640b481-74') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.objects.instance [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:11:14 user nova-compute[71692]:   <uuid>8c60e6c0-533c-4fd3-938f-b9ecc9fb0333</uuid>
Apr 13 19:11:14 user nova-compute[71692]:   <name>instance-00000014</name>
Apr 13 19:11:14 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:11:14 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:11:14 user nova-compute[71692]:   <metadata>
Apr 13 19:11:14 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:11:14 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:11:14 user nova-compute[71692]:       <nova:name>tempest-TestShelveInstance-server-83408209</nova:name>
Apr 13 19:11:14 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:11:13</nova:creationTime>
Apr 13 19:11:14 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:11:14 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:11:14 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:11:14 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:11:14 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:11:14 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:11:14 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:11:14 user nova-compute[71692]:       <nova:owner>
Apr 13 19:11:14 user nova-compute[71692]:         <nova:user uuid="e44f04fabef14935a4617dd452d3999b">tempest-TestShelveInstance-1512441304-project-member</nova:user>
Apr 13 19:11:14 user nova-compute[71692]:         <nova:project uuid="20b8fe614f0541009788ffe685720634">tempest-TestShelveInstance-1512441304</nova:project>
Apr 13 19:11:14 user nova-compute[71692]:       </nova:owner>
Apr 13 19:11:14 user nova-compute[71692]:       <nova:ports>
Apr 13 19:11:14 user nova-compute[71692]:         <nova:port uuid="8640b481-7480-494b-a88b-e21419d695cf">
Apr 13 19:11:14 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 19:11:14 user nova-compute[71692]:         </nova:port>
Apr 13 19:11:14 user nova-compute[71692]:       </nova:ports>
Apr 13 19:11:14 user nova-compute[71692]:     </nova:instance>
Apr 13 19:11:14 user nova-compute[71692]:   </metadata>
Apr 13 19:11:14 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:11:14 user nova-compute[71692]:     <system>
Apr 13 19:11:14 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:11:14 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:11:14 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:11:14 user nova-compute[71692]:       <entry name="serial">8c60e6c0-533c-4fd3-938f-b9ecc9fb0333</entry>
Apr 13 19:11:14 user nova-compute[71692]:       <entry name="uuid">8c60e6c0-533c-4fd3-938f-b9ecc9fb0333</entry>
Apr 13 19:11:14 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:11:14 user nova-compute[71692]:     </system>
Apr 13 19:11:14 user nova-compute[71692]:   </sysinfo>
Apr 13 19:11:14 user nova-compute[71692]:   <os>
Apr 13 19:11:14 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:11:14 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:11:14 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:11:14 user nova-compute[71692]:   </os>
Apr 13 19:11:14 user nova-compute[71692]:   <features>
Apr 13 19:11:14 user nova-compute[71692]:     <acpi/>
Apr 13 19:11:14 user nova-compute[71692]:     <apic/>
Apr 13 19:11:14 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:11:14 user nova-compute[71692]:   </features>
Apr 13 19:11:14 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:11:14 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:11:14 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:11:14 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:11:14 user nova-compute[71692]:   </clock>
Apr 13 19:11:14 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:11:14 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:11:14 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:11:14 user nova-compute[71692]:   </cpu>
Apr 13 19:11:14 user nova-compute[71692]:   <devices>
Apr 13 19:11:14 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:11:14 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:11:14 user nova-compute[71692]:       <source dev="/dev/sdb"/>
Apr 13 19:11:14 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:11:14 user nova-compute[71692]:       <serial>c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96</serial>
Apr 13 19:11:14 user nova-compute[71692]:     </disk>
Apr 13 19:11:14 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:11:14 user nova-compute[71692]:       <mac address="fa:16:3e:cb:e5:46"/>
Apr 13 19:11:14 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:11:14 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:11:14 user nova-compute[71692]:       <target dev="tap8640b481-74"/>
Apr 13 19:11:14 user nova-compute[71692]:     </interface>
Apr 13 19:11:14 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:11:14 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333/console.log" append="off"/>
Apr 13 19:11:14 user nova-compute[71692]:     </serial>
Apr 13 19:11:14 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:11:14 user nova-compute[71692]:     <video>
Apr 13 19:11:14 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:11:14 user nova-compute[71692]:     </video>
Apr 13 19:11:14 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:11:14 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:11:14 user nova-compute[71692]:     </rng>
Apr 13 19:11:14 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:11:14 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:11:14 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:11:14 user nova-compute[71692]:     </memballoon>
Apr 13 19:11:14 user nova-compute[71692]:   </devices>
Apr 13 19:11:14 user nova-compute[71692]: </domain>
Apr 13 19:11:14 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T19:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-83408209',display_name='tempest-TestShelveInstance-server-83408209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-83408209',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-24428880',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:07:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='20b8fe614f0541009788ffe685720634',ramdisk_id='',reservation_id='r-p03apkpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1512441304',owner_user_name='tempest-TestShelveInstance-1512441304-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:11:06Z,user_data=None,user_id='e44f04fabef14935a4617dd452d3999b',uuid=8c60e6c0-533c-4fd3-938f-b9ecc9fb0333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Converting VIF {"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e5:46,bridge_name='br-int',has_traffic_filtering=True,id=8640b481-7480-494b-a88b-e21419d695cf,network=Network(caba0c3f-498e-458e-86ba-f7a0a147a7d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8640b481-74') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG os_vif [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e5:46,bridge_name='br-int',has_traffic_filtering=True,id=8640b481-7480-494b-a88b-e21419d695cf,network=Network(caba0c3f-498e-458e-86ba-f7a0a147a7d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8640b481-74') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8640b481-74, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8640b481-74, col_values=(('external_ids', {'iface-id': '8640b481-7480-494b-a88b-e21419d695cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:e5:46', 'vm-uuid': '8c60e6c0-533c-4fd3-938f-b9ecc9fb0333'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:14 user nova-compute[71692]: INFO os_vif [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:e5:46,bridge_name='br-int',has_traffic_filtering=True,id=8640b481-7480-494b-a88b-e21419d695cf,network=Network(caba0c3f-498e-458e-86ba-f7a0a147a7d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8640b481-74')
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] No VIF found with MAC fa:16:3e:cb:e5:46, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413074.8223264, 579c83e7-7976-47f4-9f25-a194e39966ba => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:11:14 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] VM Resumed (Lifecycle Event)
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:11:14 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Instance spawned successfully.
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:11:14 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413074.8236244, 579c83e7-7976-47f4-9f25-a194e39966ba => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:11:14 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] VM Started (Lifecycle Event)
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:11:14 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:11:14 user nova-compute[71692]: INFO nova.compute.manager [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Took 5.59 seconds to spawn the instance on the hypervisor.
Apr 13 19:11:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:11:15 user nova-compute[71692]: INFO nova.compute.manager [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Took 6.24 seconds to build instance.
Apr 13 19:11:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7710f1d1-5b9e-436d-9d1b-d3e5b369b030 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "579c83e7-7976-47f4-9f25-a194e39966ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.335s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-fbc06013-1a20-4098-97aa-f5bf490b17d7 req-6e558e44-1f2e-4fa1-ab64-ea562d58fab1 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Received event network-vif-plugged-ab959649-556a-479c-9e13-ec36fb9ebb66 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:11:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-fbc06013-1a20-4098-97aa-f5bf490b17d7 req-6e558e44-1f2e-4fa1-ab64-ea562d58fab1 service nova] Acquiring lock "579c83e7-7976-47f4-9f25-a194e39966ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-fbc06013-1a20-4098-97aa-f5bf490b17d7 req-6e558e44-1f2e-4fa1-ab64-ea562d58fab1 service nova] Lock "579c83e7-7976-47f4-9f25-a194e39966ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-fbc06013-1a20-4098-97aa-f5bf490b17d7 req-6e558e44-1f2e-4fa1-ab64-ea562d58fab1 service nova] Lock "579c83e7-7976-47f4-9f25-a194e39966ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-fbc06013-1a20-4098-97aa-f5bf490b17d7 req-6e558e44-1f2e-4fa1-ab64-ea562d58fab1 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] No waiting events found dispatching network-vif-plugged-ab959649-556a-479c-9e13-ec36fb9ebb66 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:11:15 user nova-compute[71692]: WARNING nova.compute.manager [req-fbc06013-1a20-4098-97aa-f5bf490b17d7 req-6e558e44-1f2e-4fa1-ab64-ea562d58fab1 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Received unexpected event network-vif-plugged-ab959649-556a-479c-9e13-ec36fb9ebb66 for instance with vm_state active and task_state None.
Apr 13 19:11:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received event network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:11:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] Acquiring lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] No waiting events found dispatching network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:11:17 user nova-compute[71692]: WARNING nova.compute.manager [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received unexpected event network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 19:11:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received event network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:11:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] Acquiring lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] No waiting events found dispatching network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:11:17 user nova-compute[71692]: WARNING nova.compute.manager [req-58d8ed6f-9481-4490-8d40-0a8930f6a1ea req-922ecf5d-71f0-4c80-ab08-949954121b8c service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received unexpected event network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 19:11:18 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413078.3118646, 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:11:18 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] VM Resumed (Lifecycle Event)
Apr 13 19:11:18 user nova-compute[71692]: DEBUG nova.compute.manager [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:11:18 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:11:18 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Instance spawned successfully.
Apr 13 19:11:18 user nova-compute[71692]: DEBUG nova.compute.manager [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:11:18 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:11:18 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:11:18 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:11:18 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413078.312791, 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:11:18 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] VM Started (Lifecycle Event)
Apr 13 19:11:18 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-46db0089-4925-4e71-b57c-d6cb2ff8b5d8 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.041s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:18 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:11:18 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:11:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:19 user nova-compute[71692]: DEBUG nova.compute.manager [req-a124af33-c4df-4f2c-8094-6e5669b56d73 req-a9dc5415-0269-4ca8-b713-60dc43200517 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-changed-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:11:19 user nova-compute[71692]: DEBUG nova.compute.manager [req-a124af33-c4df-4f2c-8094-6e5669b56d73 req-a9dc5415-0269-4ca8-b713-60dc43200517 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Refreshing instance network info cache due to event network-changed-6d1659d8-90f3-45a5-90a0-772abe02c673. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:11:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a124af33-c4df-4f2c-8094-6e5669b56d73 req-a9dc5415-0269-4ca8-b713-60dc43200517 service nova] Acquiring lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:11:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a124af33-c4df-4f2c-8094-6e5669b56d73 req-a9dc5415-0269-4ca8-b713-60dc43200517 service nova] Acquired lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:11:19 user nova-compute[71692]: DEBUG nova.network.neutron [req-a124af33-c4df-4f2c-8094-6e5669b56d73 req-a9dc5415-0269-4ca8-b713-60dc43200517 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Refreshing network info cache for port 6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:11:20 user nova-compute[71692]: DEBUG nova.network.neutron [req-a124af33-c4df-4f2c-8094-6e5669b56d73 req-a9dc5415-0269-4ca8-b713-60dc43200517 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Updated VIF entry in instance network info cache for port 6d1659d8-90f3-45a5-90a0-772abe02c673. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:11:20 user nova-compute[71692]: DEBUG nova.network.neutron [req-a124af33-c4df-4f2c-8094-6e5669b56d73 req-a9dc5415-0269-4ca8-b713-60dc43200517 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Updating instance_info_cache with network_info: [{"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:11:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a124af33-c4df-4f2c-8094-6e5669b56d73 req-a9dc5415-0269-4ca8-b713-60dc43200517 service nova] Releasing lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:11:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:11:20 user nova-compute[71692]: INFO nova.compute.manager [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] instance snapshotting
Apr 13 19:11:20 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Beginning live snapshot process
Apr 13 19:11:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json -f qcow2 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json -f qcow2 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx7wawod0/7e917517371849f1b08fe40b98067554.delta 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx7wawod0/7e917517371849f1b08fe40b98067554.delta 1073741824" returned: 0 in 0.066s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:21 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 19:11:22 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 19:11:22 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 19:11:22 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 19:11:22 user nova-compute[71692]: DEBUG nova.privsep.utils [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 19:11:22 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx7wawod0/7e917517371849f1b08fe40b98067554.delta /opt/stack/data/nova/instances/snapshots/tmpx7wawod0/7e917517371849f1b08fe40b98067554 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx7wawod0/7e917517371849f1b08fe40b98067554.delta /opt/stack/data/nova/instances/snapshots/tmpx7wawod0/7e917517371849f1b08fe40b98067554" returned: 0 in 0.367s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:23 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Snapshot extracted, beginning image upload
Apr 13 19:11:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:25 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Snapshot image upload complete
Apr 13 19:11:25 user nova-compute[71692]: INFO nova.compute.manager [None req-e63d8e09-b165-4e9f-816e-d8d82fcd6082 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Took 4.51 seconds to snapshot the instance on the hypervisor.
Apr 13 19:11:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG nova.compute.manager [req-bfbfdd97-93d2-4619-a38e-2777f63e518d req-5ff96252-214b-4731-8d3a-9ab6e6948fd8 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Received event network-changed-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG nova.compute.manager [req-bfbfdd97-93d2-4619-a38e-2777f63e518d req-5ff96252-214b-4731-8d3a-9ab6e6948fd8 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Refreshing instance network info cache due to event network-changed-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-bfbfdd97-93d2-4619-a38e-2777f63e518d req-5ff96252-214b-4731-8d3a-9ab6e6948fd8 service nova] Acquiring lock "refresh_cache-cb3fb753-ff8d-4dac-ab70-f940233bf25d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-bfbfdd97-93d2-4619-a38e-2777f63e518d req-5ff96252-214b-4731-8d3a-9ab6e6948fd8 service nova] Acquired lock "refresh_cache-cb3fb753-ff8d-4dac-ab70-f940233bf25d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG nova.network.neutron [req-bfbfdd97-93d2-4619-a38e-2777f63e518d req-5ff96252-214b-4731-8d3a-9ab6e6948fd8 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Refreshing network info cache for port cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:35 user nova-compute[71692]: INFO nova.compute.manager [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Terminating instance
Apr 13 19:11:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG nova.network.neutron [req-bfbfdd97-93d2-4619-a38e-2777f63e518d req-5ff96252-214b-4731-8d3a-9ab6e6948fd8 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Updated VIF entry in instance network info cache for port cec3cf4d-fe86-45a6-97cc-5cbcf2be5818. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG nova.network.neutron [req-bfbfdd97-93d2-4619-a38e-2777f63e518d req-5ff96252-214b-4731-8d3a-9ab6e6948fd8 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Updating instance_info_cache with network_info: [{"id": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "address": "fa:16:3e:fd:ca:76", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec3cf4d-fe", "ovs_interfaceid": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-bfbfdd97-93d2-4619-a38e-2777f63e518d req-5ff96252-214b-4731-8d3a-9ab6e6948fd8 service nova] Releasing lock "refresh_cache-cb3fb753-ff8d-4dac-ab70-f940233bf25d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:11:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Instance destroyed successfully.
Apr 13 19:11:35 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lazy-loading 'resources' on Instance uuid cb3fb753-ff8d-4dac-ab70-f940233bf25d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:04:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-115859800',display_name='tempest-TestStampPattern-server-115859800',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-115859800',id=17,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHlW3C03mbx8npnGQJlBa+Z8VKTTGNO9FQPBpbP73f2RM1T737WN8fLrDdW9N64l6RsTGIQydByfuY41AlVN9GkKHEdIxhoJ63MlO2Jt2MVwCLy66RUUbGjTxXc1hX0iw==',key_name='tempest-TestStampPattern-550784019',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:04:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3347c59f4ca945399a4323e689460d12',ramdisk_id='',reservation_id='r-yqry0b89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-456915878',owner_user_name='tempest-TestStampPattern-456915878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:07:42Z,user_data=None,user_id='cb7bcc69770a4859904f1b66cece61e3',uuid=cb3fb753-ff8d-4dac-ab70-f940233bf25d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "address": "fa:16:3e:fd:ca:76", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec3cf4d-fe", "ovs_interfaceid": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Converting VIF {"id": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "address": "fa:16:3e:fd:ca:76", "network": {"id": "a5157bcb-9174-46af-b786-e4b159907e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-2116578392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3347c59f4ca945399a4323e689460d12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcec3cf4d-fe", "ovs_interfaceid": "cec3cf4d-fe86-45a6-97cc-5cbcf2be5818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:ca:76,bridge_name='br-int',has_traffic_filtering=True,id=cec3cf4d-fe86-45a6-97cc-5cbcf2be5818,network=Network(a5157bcb-9174-46af-b786-e4b159907e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec3cf4d-fe') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG os_vif [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:ca:76,bridge_name='br-int',has_traffic_filtering=True,id=cec3cf4d-fe86-45a6-97cc-5cbcf2be5818,network=Network(a5157bcb-9174-46af-b786-e4b159907e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec3cf4d-fe') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcec3cf4d-fe, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:35 user nova-compute[71692]: INFO os_vif [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:ca:76,bridge_name='br-int',has_traffic_filtering=True,id=cec3cf4d-fe86-45a6-97cc-5cbcf2be5818,network=Network(a5157bcb-9174-46af-b786-e4b159907e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcec3cf4d-fe')
Apr 13 19:11:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Deleting instance files /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d_del
Apr 13 19:11:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Deletion of /opt/stack/data/nova/instances/cb3fb753-ff8d-4dac-ab70-f940233bf25d_del complete
Apr 13 19:11:36 user nova-compute[71692]: INFO nova.compute.manager [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 13 19:11:36 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:11:36 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:11:36 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:11:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:36 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:11:36 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Took 0.43 seconds to deallocate network for instance.
Apr 13 19:11:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:36 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:11:36 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:11:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:36 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Deleted allocations for instance cb3fb753-ff8d-4dac-ab70-f940233bf25d
Apr 13 19:11:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e90ee244-547b-4bac-8f0f-3cb18e22b7de tempest-TestStampPattern-456915878 tempest-TestStampPattern-456915878-project-member] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.798s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:37 user nova-compute[71692]: DEBUG nova.compute.manager [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Received event network-vif-unplugged-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:11:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] Acquiring lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:37 user nova-compute[71692]: DEBUG nova.compute.manager [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] No waiting events found dispatching network-vif-unplugged-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:11:37 user nova-compute[71692]: WARNING nova.compute.manager [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Received unexpected event network-vif-unplugged-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 for instance with vm_state deleted and task_state None.
Apr 13 19:11:37 user nova-compute[71692]: DEBUG nova.compute.manager [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Received event network-vif-plugged-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:11:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] Acquiring lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] Lock "cb3fb753-ff8d-4dac-ab70-f940233bf25d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:37 user nova-compute[71692]: DEBUG nova.compute.manager [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] No waiting events found dispatching network-vif-plugged-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:11:37 user nova-compute[71692]: WARNING nova.compute.manager [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Received unexpected event network-vif-plugged-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 for instance with vm_state deleted and task_state None.
Apr 13 19:11:37 user nova-compute[71692]: DEBUG nova.compute.manager [req-482fccc0-da19-4396-ba20-43fda7925764 req-5b3bda57-9054-4ea7-9df9-3f1f8e3fb220 service nova] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Received event network-vif-deleted-cec3cf4d-fe86-45a6-97cc-5cbcf2be5818 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:11:37 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:11:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:11:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:11:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:11:39 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:11:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:42 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:11:42 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:11:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:11:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:11:42 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:11:42 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updating instance_info_cache with network_info: [{"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:11:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:11:42 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:11:42 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:11:43 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:11:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:43 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:11:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:11:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:11:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:11:45 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:11:45 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:11:45 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=7898MB free_disk=26.123794555664062GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:11:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:11:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:11:45 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:11:45 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 59d7b86a-c723-4255-827e-2f6a641239df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:11:45 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 33367b19-4d62-46dc-8346-45ea09c5563d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:11:45 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 635717f5-c514-41a7-b9dc-a03d699173c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:11:45 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:11:45 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:11:45 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 579c83e7-7976-47f4-9f25-a194e39966ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:11:45 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:11:45 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:11:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:11:46 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:11:46 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:11:46 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:11:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:11:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:48 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:11:50 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413095.9389489, cb3fb753-ff8d-4dac-ab70-f940233bf25d => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:11:50 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] VM Stopped (Lifecycle Event)
Apr 13 19:11:50 user nova-compute[71692]: DEBUG nova.compute.manager [None req-364ef3d6-9d22-4145-baee-db7c9b041a0a None None] [instance: cb3fb753-ff8d-4dac-ab70-f940233bf25d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:11:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:11:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:12:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:12:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:20 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:12:20 user nova-compute[71692]: INFO nova.compute.claims [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Claim successful on node user
Apr 13 19:12:20 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:12:20 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:12:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:12:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:12:20 user nova-compute[71692]: DEBUG nova.network.neutron [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:12:20 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:12:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:12:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:12:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:12:20 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Creating image(s)
Apr 13 19:12:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "/opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "/opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "/opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk 1073741824" returned: 0 in 0.046s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG nova.policy [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bebf61a7401492692f9c60adde178f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42fbd7089a7e4ba8b2597fca0d8e84c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Cannot resize image /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG nova.objects.instance [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'migration_context' on Instance uuid 01bd39f7-7d27-48cf-982e-181aadc060ab {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Ensure instance console log exists: /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:22 user nova-compute[71692]: DEBUG nova.network.neutron [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Successfully created port: 508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:12:22 user nova-compute[71692]: DEBUG nova.network.neutron [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Successfully updated port: 508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:12:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:12:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquired lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:12:22 user nova-compute[71692]: DEBUG nova.network.neutron [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:12:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-c14f1d2f-169d-44a9-a436-b54b10b59ced req-f443456f-c8a2-4118-b43b-add46645f251 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-changed-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:12:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-c14f1d2f-169d-44a9-a436-b54b10b59ced req-f443456f-c8a2-4118-b43b-add46645f251 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Refreshing instance network info cache due to event network-changed-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:12:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c14f1d2f-169d-44a9-a436-b54b10b59ced req-f443456f-c8a2-4118-b43b-add46645f251 service nova] Acquiring lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:12:22 user nova-compute[71692]: DEBUG nova.network.neutron [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.network.neutron [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Updating instance_info_cache with network_info: [{"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Releasing lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.compute.manager [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Instance network_info: |[{"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c14f1d2f-169d-44a9-a436-b54b10b59ced req-f443456f-c8a2-4118-b43b-add46645f251 service nova] Acquired lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.network.neutron [req-c14f1d2f-169d-44a9-a436-b54b10b59ced req-f443456f-c8a2-4118-b43b-add46645f251 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Refreshing network info cache for port 508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Start _get_guest_xml network_info=[{"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:12:23 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:12:23 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-243833659',display_name='tempest-ServerRescueNegativeTestJSON-server-243833659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-243833659',id=26,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETrtalpYQPcSKz1Uvc8zhcl0TlkdLfnCDAYE9b0Gxj6dj83NAjoPt6+VcHDiCV3eWgdAtbJV8ZhOtBKhYZ+l/OE7pG32jVdqRo02bInWOOtIHlsQQihOwUoItSmHcTOUw==',key_name='tempest-keypair-1767392597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fbd7089a7e4ba8b2597fca0d8e84c8',ramdisk_id='',reservation_id='r-vhean6yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1255770111',owner_user_name='tempest-ServerRescueNegativeTestJSON-1255770111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bebf61a7401492692f9c60adde178f7',uuid=01bd39f7-7d27-48cf-982e-181aadc060ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converting VIF {"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:81:9c,bridge_name='br-int',has_traffic_filtering=True,id=508dc44c-24c7-4474-9d8a-8cd8a20fa1d6,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap508dc44c-24') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.objects.instance [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'pci_devices' on Instance uuid 01bd39f7-7d27-48cf-982e-181aadc060ab {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:12:23 user nova-compute[71692]:   <uuid>01bd39f7-7d27-48cf-982e-181aadc060ab</uuid>
Apr 13 19:12:23 user nova-compute[71692]:   <name>instance-0000001a</name>
Apr 13 19:12:23 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:12:23 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:12:23 user nova-compute[71692]:   <metadata>
Apr 13 19:12:23 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:12:23 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:12:23 user nova-compute[71692]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-243833659</nova:name>
Apr 13 19:12:23 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:12:23</nova:creationTime>
Apr 13 19:12:23 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:12:23 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:12:23 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:12:23 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:12:23 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:12:23 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:12:23 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:12:23 user nova-compute[71692]:       <nova:owner>
Apr 13 19:12:23 user nova-compute[71692]:         <nova:user uuid="3bebf61a7401492692f9c60adde178f7">tempest-ServerRescueNegativeTestJSON-1255770111-project-member</nova:user>
Apr 13 19:12:23 user nova-compute[71692]:         <nova:project uuid="42fbd7089a7e4ba8b2597fca0d8e84c8">tempest-ServerRescueNegativeTestJSON-1255770111</nova:project>
Apr 13 19:12:23 user nova-compute[71692]:       </nova:owner>
Apr 13 19:12:23 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:12:23 user nova-compute[71692]:       <nova:ports>
Apr 13 19:12:23 user nova-compute[71692]:         <nova:port uuid="508dc44c-24c7-4474-9d8a-8cd8a20fa1d6">
Apr 13 19:12:23 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 19:12:23 user nova-compute[71692]:         </nova:port>
Apr 13 19:12:23 user nova-compute[71692]:       </nova:ports>
Apr 13 19:12:23 user nova-compute[71692]:     </nova:instance>
Apr 13 19:12:23 user nova-compute[71692]:   </metadata>
Apr 13 19:12:23 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:12:23 user nova-compute[71692]:     <system>
Apr 13 19:12:23 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:12:23 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:12:23 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:12:23 user nova-compute[71692]:       <entry name="serial">01bd39f7-7d27-48cf-982e-181aadc060ab</entry>
Apr 13 19:12:23 user nova-compute[71692]:       <entry name="uuid">01bd39f7-7d27-48cf-982e-181aadc060ab</entry>
Apr 13 19:12:23 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:12:23 user nova-compute[71692]:     </system>
Apr 13 19:12:23 user nova-compute[71692]:   </sysinfo>
Apr 13 19:12:23 user nova-compute[71692]:   <os>
Apr 13 19:12:23 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:12:23 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:12:23 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:12:23 user nova-compute[71692]:   </os>
Apr 13 19:12:23 user nova-compute[71692]:   <features>
Apr 13 19:12:23 user nova-compute[71692]:     <acpi/>
Apr 13 19:12:23 user nova-compute[71692]:     <apic/>
Apr 13 19:12:23 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:12:23 user nova-compute[71692]:   </features>
Apr 13 19:12:23 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:12:23 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:12:23 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:12:23 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:12:23 user nova-compute[71692]:   </clock>
Apr 13 19:12:23 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:12:23 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:12:23 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:12:23 user nova-compute[71692]:   </cpu>
Apr 13 19:12:23 user nova-compute[71692]:   <devices>
Apr 13 19:12:23 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:12:23 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:12:23 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk"/>
Apr 13 19:12:23 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:12:23 user nova-compute[71692]:     </disk>
Apr 13 19:12:23 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:12:23 user nova-compute[71692]:       <mac address="fa:16:3e:5a:81:9c"/>
Apr 13 19:12:23 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:12:23 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:12:23 user nova-compute[71692]:       <target dev="tap508dc44c-24"/>
Apr 13 19:12:23 user nova-compute[71692]:     </interface>
Apr 13 19:12:23 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:12:23 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/console.log" append="off"/>
Apr 13 19:12:23 user nova-compute[71692]:     </serial>
Apr 13 19:12:23 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:12:23 user nova-compute[71692]:     <video>
Apr 13 19:12:23 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:12:23 user nova-compute[71692]:     </video>
Apr 13 19:12:23 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:12:23 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:12:23 user nova-compute[71692]:     </rng>
Apr 13 19:12:23 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:12:23 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:12:23 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:12:23 user nova-compute[71692]:     </memballoon>
Apr 13 19:12:23 user nova-compute[71692]:   </devices>
Apr 13 19:12:23 user nova-compute[71692]: </domain>
Apr 13 19:12:23 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-243833659',display_name='tempest-ServerRescueNegativeTestJSON-server-243833659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-243833659',id=26,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETrtalpYQPcSKz1Uvc8zhcl0TlkdLfnCDAYE9b0Gxj6dj83NAjoPt6+VcHDiCV3eWgdAtbJV8ZhOtBKhYZ+l/OE7pG32jVdqRo02bInWOOtIHlsQQihOwUoItSmHcTOUw==',key_name='tempest-keypair-1767392597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42fbd7089a7e4ba8b2597fca0d8e84c8',ramdisk_id='',reservation_id='r-vhean6yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1255770111',owner_user_name='tempest-ServerRescueNegativeTestJSON-1255770111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:12:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bebf61a7401492692f9c60adde178f7',uuid=01bd39f7-7d27-48cf-982e-181aadc060ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converting VIF {"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:81:9c,bridge_name='br-int',has_traffic_filtering=True,id=508dc44c-24c7-4474-9d8a-8cd8a20fa1d6,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap508dc44c-24') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG os_vif [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:81:9c,bridge_name='br-int',has_traffic_filtering=True,id=508dc44c-24c7-4474-9d8a-8cd8a20fa1d6,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap508dc44c-24') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap508dc44c-24, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap508dc44c-24, col_values=(('external_ids', {'iface-id': '508dc44c-24c7-4474-9d8a-8cd8a20fa1d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:81:9c', 'vm-uuid': '01bd39f7-7d27-48cf-982e-181aadc060ab'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:23 user nova-compute[71692]: INFO os_vif [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:81:9c,bridge_name='br-int',has_traffic_filtering=True,id=508dc44c-24c7-4474-9d8a-8cd8a20fa1d6,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap508dc44c-24')
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No VIF found with MAC fa:16:3e:5a:81:9c, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.network.neutron [req-c14f1d2f-169d-44a9-a436-b54b10b59ced req-f443456f-c8a2-4118-b43b-add46645f251 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Updated VIF entry in instance network info cache for port 508dc44c-24c7-4474-9d8a-8cd8a20fa1d6. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG nova.network.neutron [req-c14f1d2f-169d-44a9-a436-b54b10b59ced req-f443456f-c8a2-4118-b43b-add46645f251 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Updating instance_info_cache with network_info: [{"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:12:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c14f1d2f-169d-44a9-a436-b54b10b59ced req-f443456f-c8a2-4118-b43b-add46645f251 service nova] Releasing lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:12:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-7f806e26-b353-494a-a42a-44fdf5ad16e2 req-b7fb0529-3158-4495-a94f-ead3dd497e38 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:12:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7f806e26-b353-494a-a42a-44fdf5ad16e2 req-b7fb0529-3158-4495-a94f-ead3dd497e38 service nova] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7f806e26-b353-494a-a42a-44fdf5ad16e2 req-b7fb0529-3158-4495-a94f-ead3dd497e38 service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7f806e26-b353-494a-a42a-44fdf5ad16e2 req-b7fb0529-3158-4495-a94f-ead3dd497e38 service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-7f806e26-b353-494a-a42a-44fdf5ad16e2 req-b7fb0529-3158-4495-a94f-ead3dd497e38 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] No waiting events found dispatching network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:12:24 user nova-compute[71692]: WARNING nova.compute.manager [req-7f806e26-b353-494a-a42a-44fdf5ad16e2 req-b7fb0529-3158-4495-a94f-ead3dd497e38 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received unexpected event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance with vm_state building and task_state spawning.
Apr 13 19:12:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413146.6777425, 01bd39f7-7d27-48cf-982e-181aadc060ab => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:12:26 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] VM Resumed (Lifecycle Event)
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.compute.manager [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:12:26 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Instance spawned successfully.
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:12:26 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413146.6791763, 01bd39f7-7d27-48cf-982e-181aadc060ab => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:12:26 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] VM Started (Lifecycle Event)
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:12:26 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:12:26 user nova-compute[71692]: INFO nova.compute.manager [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Took 5.90 seconds to spawn the instance on the hypervisor.
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.compute.manager [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:12:26 user nova-compute[71692]: INFO nova.compute.manager [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Took 6.59 seconds to build instance.
Apr 13 19:12:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-567346b8-9cdf-47d7-a042-3af7e3066373 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.688s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.compute.manager [req-449cb9f0-d8a8-41a3-8e44-32b5adae7b9a req-dd93d454-0750-4b02-b444-bba0b92c9b26 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:12:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-449cb9f0-d8a8-41a3-8e44-32b5adae7b9a req-dd93d454-0750-4b02-b444-bba0b92c9b26 service nova] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-449cb9f0-d8a8-41a3-8e44-32b5adae7b9a req-dd93d454-0750-4b02-b444-bba0b92c9b26 service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-449cb9f0-d8a8-41a3-8e44-32b5adae7b9a req-dd93d454-0750-4b02-b444-bba0b92c9b26 service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:26 user nova-compute[71692]: DEBUG nova.compute.manager [req-449cb9f0-d8a8-41a3-8e44-32b5adae7b9a req-dd93d454-0750-4b02-b444-bba0b92c9b26 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] No waiting events found dispatching network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:12:26 user nova-compute[71692]: WARNING nova.compute.manager [req-449cb9f0-d8a8-41a3-8e44-32b5adae7b9a req-dd93d454-0750-4b02-b444-bba0b92c9b26 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received unexpected event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance with vm_state active and task_state None.
Apr 13 19:12:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "635717f5-c514-41a7-b9dc-a03d699173c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "635717f5-c514-41a7-b9dc-a03d699173c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:29 user nova-compute[71692]: INFO nova.compute.manager [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Terminating instance
Apr 13 19:12:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG nova.compute.manager [req-7acb478d-6f9f-4184-902e-35fb9fbcf9ce req-c67692cc-ee90-42da-bc63-233ec87f6f64 service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Received event network-vif-unplugged-78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7acb478d-6f9f-4184-902e-35fb9fbcf9ce req-c67692cc-ee90-42da-bc63-233ec87f6f64 service nova] Acquiring lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7acb478d-6f9f-4184-902e-35fb9fbcf9ce req-c67692cc-ee90-42da-bc63-233ec87f6f64 service nova] Lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7acb478d-6f9f-4184-902e-35fb9fbcf9ce req-c67692cc-ee90-42da-bc63-233ec87f6f64 service nova] Lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG nova.compute.manager [req-7acb478d-6f9f-4184-902e-35fb9fbcf9ce req-c67692cc-ee90-42da-bc63-233ec87f6f64 service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] No waiting events found dispatching network-vif-unplugged-78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG nova.compute.manager [req-7acb478d-6f9f-4184-902e-35fb9fbcf9ce req-c67692cc-ee90-42da-bc63-233ec87f6f64 service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Received event network-vif-unplugged-78f7925f-87b3-4251-90e4-aec51a11e4ec for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Instance destroyed successfully.
Apr 13 19:12:29 user nova-compute[71692]: DEBUG nova.objects.instance [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lazy-loading 'resources' on Instance uuid 635717f5-c514-41a7-b9dc-a03d699173c5 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:10:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-444502434',display_name='tempest-VolumesActionsTest-instance-444502434',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-444502434',id=23,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:10:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2877676ccbd0484d80ecabf3030c0ee4',ramdisk_id='',reservation_id='r-8gqzws3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-427747232',owner_user_name='tempest-VolumesActionsTest-427747232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:10:45Z,user_data=None,user_id='80063ed703d24a1b84aede724db205a7',uuid=635717f5-c514-41a7-b9dc-a03d699173c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "address": "fa:16:3e:c5:95:79", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7925f-87", "ovs_interfaceid": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Converting VIF {"id": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "address": "fa:16:3e:c5:95:79", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7925f-87", "ovs_interfaceid": "78f7925f-87b3-4251-90e4-aec51a11e4ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:95:79,bridge_name='br-int',has_traffic_filtering=True,id=78f7925f-87b3-4251-90e4-aec51a11e4ec,network=Network(b34bf81f-6825-4376-a26c-35386631a4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f7925f-87') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG os_vif [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:95:79,bridge_name='br-int',has_traffic_filtering=True,id=78f7925f-87b3-4251-90e4-aec51a11e4ec,network=Network(b34bf81f-6825-4376-a26c-35386631a4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f7925f-87') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78f7925f-87, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:12:29 user nova-compute[71692]: INFO os_vif [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:95:79,bridge_name='br-int',has_traffic_filtering=True,id=78f7925f-87b3-4251-90e4-aec51a11e4ec,network=Network(b34bf81f-6825-4376-a26c-35386631a4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78f7925f-87')
Apr 13 19:12:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Deleting instance files /opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5_del
Apr 13 19:12:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Deletion of /opt/stack/data/nova/instances/635717f5-c514-41a7-b9dc-a03d699173c5_del complete
Apr 13 19:12:29 user nova-compute[71692]: INFO nova.compute.manager [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Took 0.82 seconds to destroy the instance on the hypervisor.
Apr 13 19:12:29 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:12:29 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:12:30 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:12:30 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Took 0.85 seconds to deallocate network for instance.
Apr 13 19:12:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:31 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Deleted allocations for instance 635717f5-c514-41a7-b9dc-a03d699173c5
Apr 13 19:12:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Received event network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Acquiring lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] No waiting events found dispatching network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:12:31 user nova-compute[71692]: WARNING nova.compute.manager [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Received unexpected event network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec for instance with vm_state deleted and task_state None.
Apr 13 19:12:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Received event network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Acquiring lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] No waiting events found dispatching network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:12:31 user nova-compute[71692]: WARNING nova.compute.manager [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Received unexpected event network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec for instance with vm_state deleted and task_state None.
Apr 13 19:12:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Received event network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Acquiring lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] No waiting events found dispatching network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:12:31 user nova-compute[71692]: WARNING nova.compute.manager [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Received unexpected event network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec for instance with vm_state deleted and task_state None.
Apr 13 19:12:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Received event network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Acquiring lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] Lock "635717f5-c514-41a7-b9dc-a03d699173c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] No waiting events found dispatching network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:12:31 user nova-compute[71692]: WARNING nova.compute.manager [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Received unexpected event network-vif-plugged-78f7925f-87b3-4251-90e4-aec51a11e4ec for instance with vm_state deleted and task_state None.
Apr 13 19:12:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-5e433037-9da5-4938-83dc-fe17167955b6 req-a7757bcd-4b11-4248-8183-5ad0f9e3e0cd service nova] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Received event network-vif-deleted-78f7925f-87b3-4251-90e4-aec51a11e4ec {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:12:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2afe2e76-21f2-48be-aa8b-c82ffcdfa742 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "635717f5-c514-41a7-b9dc-a03d699173c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.378s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:36 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:12:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:12:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:12:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:12:39 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:12:39 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:12:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:40 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:12:40 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:12:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:43 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:12:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:12:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 19:12:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:12:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:12:43 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:12:43 user nova-compute[71692]: DEBUG nova.objects.instance [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lazy-loading 'info_cache' on Instance uuid 29eeca99-f237-49d9-9c7d-5c5b7ff2892f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:12:43 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Updating instance_info_cache with network_info: [{"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:12:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:12:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413149.6781416, 635717f5-c514-41a7-b9dc-a03d699173c5 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:12:44 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] VM Stopped (Lifecycle Event)
Apr 13 19:12:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-904e8879-f355-4f77-8405-cf82a6d7b3ab None None] [instance: 635717f5-c514-41a7-b9dc-a03d699173c5] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:12:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:46 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:12:46 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:12:46 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8042MB free_disk=26.111663818359375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:12:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 59d7b86a-c723-4255-827e-2f6a641239df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 33367b19-4d62-46dc-8346-45ea09c5563d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 579c83e7-7976-47f4-9f25-a194e39966ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 01bd39f7-7d27-48cf-982e-181aadc060ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing inventories for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating ProviderTree inventory for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating inventory in ProviderTree for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing aggregate associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, aggregates: None {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing trait associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.646s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] There are 0 instances to clean {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:12:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 19:12:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:49 user nova-compute[71692]: DEBUG nova.compute.manager [req-a150f758-7029-44ff-8a6c-2655083ab5dd req-7406cffb-e5fb-4ef7-8659-8a966bd2db6a service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Received event network-changed-e124e179-0315-423a-b9cf-c232753845ed {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:12:49 user nova-compute[71692]: DEBUG nova.compute.manager [req-a150f758-7029-44ff-8a6c-2655083ab5dd req-7406cffb-e5fb-4ef7-8659-8a966bd2db6a service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Refreshing instance network info cache due to event network-changed-e124e179-0315-423a-b9cf-c232753845ed. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:12:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a150f758-7029-44ff-8a6c-2655083ab5dd req-7406cffb-e5fb-4ef7-8659-8a966bd2db6a service nova] Acquiring lock "refresh_cache-ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:12:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a150f758-7029-44ff-8a6c-2655083ab5dd req-7406cffb-e5fb-4ef7-8659-8a966bd2db6a service nova] Acquired lock "refresh_cache-ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:12:49 user nova-compute[71692]: DEBUG nova.network.neutron [req-a150f758-7029-44ff-8a6c-2655083ab5dd req-7406cffb-e5fb-4ef7-8659-8a966bd2db6a service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Refreshing network info cache for port e124e179-0315-423a-b9cf-c232753845ed {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:12:49 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:12:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:50 user nova-compute[71692]: DEBUG nova.network.neutron [req-a150f758-7029-44ff-8a6c-2655083ab5dd req-7406cffb-e5fb-4ef7-8659-8a966bd2db6a service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Updated VIF entry in instance network info cache for port e124e179-0315-423a-b9cf-c232753845ed. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:12:50 user nova-compute[71692]: DEBUG nova.network.neutron [req-a150f758-7029-44ff-8a6c-2655083ab5dd req-7406cffb-e5fb-4ef7-8659-8a966bd2db6a service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Updating instance_info_cache with network_info: [{"id": "e124e179-0315-423a-b9cf-c232753845ed", "address": "fa:16:3e:1a:cf:e4", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape124e179-03", "ovs_interfaceid": "e124e179-0315-423a-b9cf-c232753845ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:12:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a150f758-7029-44ff-8a6c-2655083ab5dd req-7406cffb-e5fb-4ef7-8659-8a966bd2db6a service nova] Releasing lock "refresh_cache-ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:12:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:50 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'flavor' on Instance uuid ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:12:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:51 user nova-compute[71692]: INFO nova.compute.manager [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Attaching volume cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 to /dev/vdb
Apr 13 19:12:51 user nova-compute[71692]: DEBUG os_brick.utils [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[811c131f-6bc6-4c34-b39f-1d89c7e21993]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9808ec-9d99-4c43-bca6-816ff13f5b7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4555c5cb-2406-4127-aff8-de3c1b869206]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[383f2c0f-414a-4499-bb63-c41ebdfe2587]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:12:51 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:12:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[65836e86-44cf-4724-b199-7d6b9a057ad6]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG os_brick.utils [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Updating existing volume attachment record: ef81aae8-6196-48bb-b2b0-ab9c46d738f8 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:12:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:12:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:53 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:12:53 user nova-compute[71692]: INFO nova.compute.claims [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Claim successful on node user
Apr 13 19:12:53 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG nova.network.neutron [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:12:54 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:12:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG nova.policy [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60dea69daeb2475f84b5a46821288be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b7cc9c0ba145bea0585e887a92c788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:12:54 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Creating image(s)
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "/opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "/opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "/opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk 1073741824" returned: 0 in 0.051s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Checking if we can resize image /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Cannot resize image /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG nova.objects.instance [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'migration_context' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Ensure instance console log exists: /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG nova.network.neutron [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Successfully created port: a29956b4-c9c2-4c86-bf4a-488fb5f45af0 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIHxjTbq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:12:55 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:12:55 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:12:55 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb2e97f-79fd-4f0a-b20b-6b5959dad7b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:12:55 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb13ec55-f151-45ec-857b-1470482f56d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7] added
Apr 13 19:12:55 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fede3a1-df3b-4d65-a5b7-b19da7a932f3]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48b7f1d-b79d-4fd0-82bd-69346a4a2215]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XIHxjTbq {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XIHxjTbq" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7a2fe2-bca5-42a2-89e1-463683cdf7f8]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XIHxjTbq'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfbe1db-aa77-41e2-a007-00fe8271e393]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f343317c-0bfa-4560-924e-721ecd858f22]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:12:55 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:12:55 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG nova.network.neutron [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Successfully updated port: a29956b4-c9c2-4c86-bf4a-488fb5f45af0 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "refresh_cache-080204b2-fd4d-4224-b391-a27036d058ac" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquired lock "refresh_cache-080204b2-fd4d-4224-b391-a27036d058ac" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG nova.network.neutron [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf2c23b-2751-4d38-8162-e21f250e7305]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7, portal: 172.16.0.220,3260]
Apr 13 19:12:55 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7, portal: 172.16.0.220,3260] successful.
Apr 13 19:12:55 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG nova.compute.manager [req-1f41c7e3-c953-4b45-aa51-01b06def3fa5 req-f28ce1c2-b226-48d9-85c7-1476bce026fa service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Received event network-changed-a29956b4-c9c2-4c86-bf4a-488fb5f45af0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG nova.compute.manager [req-1f41c7e3-c953-4b45-aa51-01b06def3fa5 req-f28ce1c2-b226-48d9-85c7-1476bce026fa service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Refreshing instance network info cache due to event network-changed-a29956b4-c9c2-4c86-bf4a-488fb5f45af0. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1f41c7e3-c953-4b45-aa51-01b06def3fa5 req-f28ce1c2-b226-48d9-85c7-1476bce026fa service nova] Acquiring lock "refresh_cache-080204b2-fd4d-4224-b391-a27036d058ac" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4fb01b-eda1-4559-b2d2-54152e6e40e3]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9d1c75-120b-432e-9a3c-6fa248987a4f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:12:55 user nova-compute[71692]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:12:55 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:12:55 user nova-compute[71692]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:12:55 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG nova.network.neutron [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c485d38-7cb8-4f88-b273-60c96737c8bb]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:12:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIHxjTbq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.network.neutron [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Updating instance_info_cache with network_info: [{"id": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "address": "fa:16:3e:8e:c2:1f", "network": {"id": "f73b1428-f00d-4eeb-91eb-d5c99ee34946", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-533041060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b7cc9c0ba145bea0585e887a92c788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa29956b4-c9", "ovs_interfaceid": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Releasing lock "refresh_cache-080204b2-fd4d-4224-b391-a27036d058ac" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Instance network_info: |[{"id": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "address": "fa:16:3e:8e:c2:1f", "network": {"id": "f73b1428-f00d-4eeb-91eb-d5c99ee34946", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-533041060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b7cc9c0ba145bea0585e887a92c788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa29956b4-c9", "ovs_interfaceid": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1f41c7e3-c953-4b45-aa51-01b06def3fa5 req-f28ce1c2-b226-48d9-85c7-1476bce026fa service nova] Acquired lock "refresh_cache-080204b2-fd4d-4224-b391-a27036d058ac" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.network.neutron [req-1f41c7e3-c953-4b45-aa51-01b06def3fa5 req-f28ce1c2-b226-48d9-85c7-1476bce026fa service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Refreshing network info cache for port a29956b4-c9c2-4c86-bf4a-488fb5f45af0 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Start _get_guest_xml network_info=[{"id": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "address": "fa:16:3e:8e:c2:1f", "network": {"id": "f73b1428-f00d-4eeb-91eb-d5c99ee34946", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-533041060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b7cc9c0ba145bea0585e887a92c788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa29956b4-c9", "ovs_interfaceid": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:12:56 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:12:56 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:12:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-56826252',display_name='tempest-SnapshotDataIntegrityTests-server-56826252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-56826252',id=27,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxycQUgxgvX4KrgSogh/FASMjBbt5FoL1Bm1OSdfsr2+D71mN0wUg1CoONDh6D08fd9G3ZLcmygPYoHkYKYM7UcbNhGrJakuHGCpIrB6MuMLJflBJ0+myyAMtN9XEOSGg==',key_name='tempest-SnapshotDataIntegrityTests-1182290909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0b7cc9c0ba145bea0585e887a92c788',ramdisk_id='',reservation_id='r-8lp2gpxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-679043734',owner_user_name='tempest-SnapshotDataIntegrityTests-679043734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:12:54Z,user_data=None,user_id='60dea69daeb2475f84b5a46821288be9',uuid=080204b2-fd4d-4224-b391-a27036d058ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "address": "fa:16:3e:8e:c2:1f", "network": {"id": "f73b1428-f00d-4eeb-91eb-d5c99ee34946", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-533041060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b7cc9c0ba145bea0585e887a92c788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa29956b4-c9", "ovs_interfaceid": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Converting VIF {"id": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "address": "fa:16:3e:8e:c2:1f", "network": {"id": "f73b1428-f00d-4eeb-91eb-d5c99ee34946", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-533041060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b7cc9c0ba145bea0585e887a92c788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa29956b4-c9", "ovs_interfaceid": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:c2:1f,bridge_name='br-int',has_traffic_filtering=True,id=a29956b4-c9c2-4c86-bf4a-488fb5f45af0,network=Network(f73b1428-f00d-4eeb-91eb-d5c99ee34946),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa29956b4-c9') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.objects.instance [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'pci_devices' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:12:56 user nova-compute[71692]:   <uuid>080204b2-fd4d-4224-b391-a27036d058ac</uuid>
Apr 13 19:12:56 user nova-compute[71692]:   <name>instance-0000001b</name>
Apr 13 19:12:56 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:12:56 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:12:56 user nova-compute[71692]:   <metadata>
Apr 13 19:12:56 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:12:56 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:12:56 user nova-compute[71692]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-56826252</nova:name>
Apr 13 19:12:56 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:12:56</nova:creationTime>
Apr 13 19:12:56 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:12:56 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:12:56 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:12:56 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:12:56 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:12:56 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:12:56 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:12:56 user nova-compute[71692]:       <nova:owner>
Apr 13 19:12:56 user nova-compute[71692]:         <nova:user uuid="60dea69daeb2475f84b5a46821288be9">tempest-SnapshotDataIntegrityTests-679043734-project-member</nova:user>
Apr 13 19:12:56 user nova-compute[71692]:         <nova:project uuid="a0b7cc9c0ba145bea0585e887a92c788">tempest-SnapshotDataIntegrityTests-679043734</nova:project>
Apr 13 19:12:56 user nova-compute[71692]:       </nova:owner>
Apr 13 19:12:56 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:12:56 user nova-compute[71692]:       <nova:ports>
Apr 13 19:12:56 user nova-compute[71692]:         <nova:port uuid="a29956b4-c9c2-4c86-bf4a-488fb5f45af0">
Apr 13 19:12:56 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 19:12:56 user nova-compute[71692]:         </nova:port>
Apr 13 19:12:56 user nova-compute[71692]:       </nova:ports>
Apr 13 19:12:56 user nova-compute[71692]:     </nova:instance>
Apr 13 19:12:56 user nova-compute[71692]:   </metadata>
Apr 13 19:12:56 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:12:56 user nova-compute[71692]:     <system>
Apr 13 19:12:56 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:12:56 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:12:56 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:12:56 user nova-compute[71692]:       <entry name="serial">080204b2-fd4d-4224-b391-a27036d058ac</entry>
Apr 13 19:12:56 user nova-compute[71692]:       <entry name="uuid">080204b2-fd4d-4224-b391-a27036d058ac</entry>
Apr 13 19:12:56 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:12:56 user nova-compute[71692]:     </system>
Apr 13 19:12:56 user nova-compute[71692]:   </sysinfo>
Apr 13 19:12:56 user nova-compute[71692]:   <os>
Apr 13 19:12:56 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:12:56 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:12:56 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:12:56 user nova-compute[71692]:   </os>
Apr 13 19:12:56 user nova-compute[71692]:   <features>
Apr 13 19:12:56 user nova-compute[71692]:     <acpi/>
Apr 13 19:12:56 user nova-compute[71692]:     <apic/>
Apr 13 19:12:56 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:12:56 user nova-compute[71692]:   </features>
Apr 13 19:12:56 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:12:56 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:12:56 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:12:56 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:12:56 user nova-compute[71692]:   </clock>
Apr 13 19:12:56 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:12:56 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:12:56 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:12:56 user nova-compute[71692]:   </cpu>
Apr 13 19:12:56 user nova-compute[71692]:   <devices>
Apr 13 19:12:56 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:12:56 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:12:56 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk"/>
Apr 13 19:12:56 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:12:56 user nova-compute[71692]:     </disk>
Apr 13 19:12:56 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:12:56 user nova-compute[71692]:       <mac address="fa:16:3e:8e:c2:1f"/>
Apr 13 19:12:56 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:12:56 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:12:56 user nova-compute[71692]:       <target dev="tapa29956b4-c9"/>
Apr 13 19:12:56 user nova-compute[71692]:     </interface>
Apr 13 19:12:56 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:12:56 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/console.log" append="off"/>
Apr 13 19:12:56 user nova-compute[71692]:     </serial>
Apr 13 19:12:56 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:12:56 user nova-compute[71692]:     <video>
Apr 13 19:12:56 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:12:56 user nova-compute[71692]:     </video>
Apr 13 19:12:56 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:12:56 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:12:56 user nova-compute[71692]:     </rng>
Apr 13 19:12:56 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:12:56 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:12:56 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:12:56 user nova-compute[71692]:     </memballoon>
Apr 13 19:12:56 user nova-compute[71692]:   </devices>
Apr 13 19:12:56 user nova-compute[71692]: </domain>
Apr 13 19:12:56 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:12:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-56826252',display_name='tempest-SnapshotDataIntegrityTests-server-56826252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-56826252',id=27,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxycQUgxgvX4KrgSogh/FASMjBbt5FoL1Bm1OSdfsr2+D71mN0wUg1CoONDh6D08fd9G3ZLcmygPYoHkYKYM7UcbNhGrJakuHGCpIrB6MuMLJflBJ0+myyAMtN9XEOSGg==',key_name='tempest-SnapshotDataIntegrityTests-1182290909',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0b7cc9c0ba145bea0585e887a92c788',ramdisk_id='',reservation_id='r-8lp2gpxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-679043734',owner_user_name='tempest-SnapshotDataIntegrityTests-679043734-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:12:54Z,user_data=None,user_id='60dea69daeb2475f84b5a46821288be9',uuid=080204b2-fd4d-4224-b391-a27036d058ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "address": "fa:16:3e:8e:c2:1f", "network": {"id": "f73b1428-f00d-4eeb-91eb-d5c99ee34946", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-533041060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b7cc9c0ba145bea0585e887a92c788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa29956b4-c9", "ovs_interfaceid": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Converting VIF {"id": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "address": "fa:16:3e:8e:c2:1f", "network": {"id": "f73b1428-f00d-4eeb-91eb-d5c99ee34946", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-533041060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b7cc9c0ba145bea0585e887a92c788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa29956b4-c9", "ovs_interfaceid": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:c2:1f,bridge_name='br-int',has_traffic_filtering=True,id=a29956b4-c9c2-4c86-bf4a-488fb5f45af0,network=Network(f73b1428-f00d-4eeb-91eb-d5c99ee34946),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa29956b4-c9') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG os_vif [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:c2:1f,bridge_name='br-int',has_traffic_filtering=True,id=a29956b4-c9c2-4c86-bf4a-488fb5f45af0,network=Network(f73b1428-f00d-4eeb-91eb-d5c99ee34946),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa29956b4-c9') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa29956b4-c9, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa29956b4-c9, col_values=(('external_ids', {'iface-id': 'a29956b4-c9c2-4c86-bf4a-488fb5f45af0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:c2:1f', 'vm-uuid': '080204b2-fd4d-4224-b391-a27036d058ac'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:56 user nova-compute[71692]: INFO os_vif [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:c2:1f,bridge_name='br-int',has_traffic_filtering=True,id=a29956b4-c9c2-4c86-bf4a-488fb5f45af0,network=Network(f73b1428-f00d-4eeb-91eb-d5c99ee34946),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa29956b4-c9')
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] No VIF found with MAC fa:16:3e:8e:c2:1f, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.network.neutron [req-1f41c7e3-c953-4b45-aa51-01b06def3fa5 req-f28ce1c2-b226-48d9-85c7-1476bce026fa service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Updated VIF entry in instance network info cache for port a29956b4-c9c2-4c86-bf4a-488fb5f45af0. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.network.neutron [req-1f41c7e3-c953-4b45-aa51-01b06def3fa5 req-f28ce1c2-b226-48d9-85c7-1476bce026fa service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Updating instance_info_cache with network_info: [{"id": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "address": "fa:16:3e:8e:c2:1f", "network": {"id": "f73b1428-f00d-4eeb-91eb-d5c99ee34946", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-533041060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b7cc9c0ba145bea0585e887a92c788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa29956b4-c9", "ovs_interfaceid": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1f41c7e3-c953-4b45-aa51-01b06def3fa5 req-f28ce1c2-b226-48d9-85c7-1476bce026fa service nova] Releasing lock "refresh_cache-080204b2-fd4d-4224-b391-a27036d058ac" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23163323633303863', 'path': '/dev/sdc'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163323633303863', 'path': '/dev/sdc'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'flavor' on Instance uuid ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:12:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:12:56 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:12:56 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:12:56 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:12:56 user nova-compute[71692]:   <serial>cc03d2f5-5d25-4ada-bde0-5c2d270b60f7</serial>
Apr 13 19:12:56 user nova-compute[71692]: </disk>
Apr 13 19:12:56 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG nova.compute.manager [req-bf179682-fd3f-472d-b042-825084950637 req-23bb71e3-a799-49ca-9562-395ecc73bfab service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received event network-changed-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG nova.compute.manager [req-bf179682-fd3f-472d-b042-825084950637 req-23bb71e3-a799-49ca-9562-395ecc73bfab service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Refreshing instance network info cache due to event network-changed-8640b481-7480-494b-a88b-e21419d695cf. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-bf179682-fd3f-472d-b042-825084950637 req-23bb71e3-a799-49ca-9562-395ecc73bfab service nova] Acquiring lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-bf179682-fd3f-472d-b042-825084950637 req-23bb71e3-a799-49ca-9562-395ecc73bfab service nova] Acquired lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG nova.network.neutron [req-bf179682-fd3f-472d-b042-825084950637 req-23bb71e3-a799-49ca-9562-395ecc73bfab service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Refreshing network info cache for port 8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:57 user nova-compute[71692]: INFO nova.compute.manager [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Terminating instance
Apr 13 19:12:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] No VIF found with MAC fa:16:3e:1a:cf:e4, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e005a71f-2b4c-4d69-a0da-08e3e66e2399 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.561s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG nova.network.neutron [req-bf179682-fd3f-472d-b042-825084950637 req-23bb71e3-a799-49ca-9562-395ecc73bfab service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updated VIF entry in instance network info cache for port 8640b481-7480-494b-a88b-e21419d695cf. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG nova.network.neutron [req-bf179682-fd3f-472d-b042-825084950637 req-23bb71e3-a799-49ca-9562-395ecc73bfab service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updating instance_info_cache with network_info: [{"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-bf179682-fd3f-472d-b042-825084950637 req-23bb71e3-a799-49ca-9562-395ecc73bfab service nova] Releasing lock "refresh_cache-8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:12:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG nova.compute.manager [req-ca80d722-2a66-4228-81a8-e0588616011f req-00963705-3601-4cc7-8165-676cf9e7383f service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Received event network-vif-plugged-a29956b4-c9c2-4c86-bf4a-488fb5f45af0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ca80d722-2a66-4228-81a8-e0588616011f req-00963705-3601-4cc7-8165-676cf9e7383f service nova] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ca80d722-2a66-4228-81a8-e0588616011f req-00963705-3601-4cc7-8165-676cf9e7383f service nova] Lock "080204b2-fd4d-4224-b391-a27036d058ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ca80d722-2a66-4228-81a8-e0588616011f req-00963705-3601-4cc7-8165-676cf9e7383f service nova] Lock "080204b2-fd4d-4224-b391-a27036d058ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG nova.compute.manager [req-ca80d722-2a66-4228-81a8-e0588616011f req-00963705-3601-4cc7-8165-676cf9e7383f service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] No waiting events found dispatching network-vif-plugged-a29956b4-c9c2-4c86-bf4a-488fb5f45af0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:12:58 user nova-compute[71692]: WARNING nova.compute.manager [req-ca80d722-2a66-4228-81a8-e0588616011f req-00963705-3601-4cc7-8165-676cf9e7383f service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Received unexpected event network-vif-plugged-a29956b4-c9c2-4c86-bf4a-488fb5f45af0 for instance with vm_state building and task_state spawning.
Apr 13 19:12:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:58 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Instance destroyed successfully.
Apr 13 19:12:58 user nova-compute[71692]: DEBUG nova.objects.instance [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lazy-loading 'resources' on Instance uuid 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T19:07:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-83408209',display_name='tempest-TestShelveInstance-server-83408209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-83408209',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIq1t/DMvVpTcEEakPI/0JWmf4BthPiZo8lPCqhHBmih4IYVT4syad6jzJ8PVHxlvM4PPItdyY2igXoht4WeZ8Uv1bT9f9eJhSMIlwuyiyywQzUvP/REC4xOo31hpBbNg==',key_name='tempest-TestShelveInstance-24428880',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:11:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20b8fe614f0541009788ffe685720634',ramdisk_id='',reservation_id='r-p03apkpm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1512441304',owner_user_name='tempest-TestShelveInstance-1512441304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:11:18Z,user_data=None,user_id='e44f04fabef14935a4617dd452d3999b',uuid=8c60e6c0-533c-4fd3-938f-b9ecc9fb0333,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Converting VIF {"id": "8640b481-7480-494b-a88b-e21419d695cf", "address": "fa:16:3e:cb:e5:46", "network": {"id": "caba0c3f-498e-458e-86ba-f7a0a147a7d7", "bridge": "br-int", "label": "tempest-TestShelveInstance-1940055151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8fe614f0541009788ffe685720634", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8640b481-74", "ovs_interfaceid": "8640b481-7480-494b-a88b-e21419d695cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:e5:46,bridge_name='br-int',has_traffic_filtering=True,id=8640b481-7480-494b-a88b-e21419d695cf,network=Network(caba0c3f-498e-458e-86ba-f7a0a147a7d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8640b481-74') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_vif [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:e5:46,bridge_name='br-int',has_traffic_filtering=True,id=8640b481-7480-494b-a88b-e21419d695cf,network=Network(caba0c3f-498e-458e-86ba-f7a0a147a7d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8640b481-74') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8640b481-74, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:12:58 user nova-compute[71692]: INFO os_vif [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:e5:46,bridge_name='br-int',has_traffic_filtering=True,id=8640b481-7480-494b-a88b-e21419d695cf,network=Network(caba0c3f-498e-458e-86ba-f7a0a147a7d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8640b481-74')
Apr 13 19:12:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NeMxmspT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:12:58 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba5f39a-c934-4466-930e-7f2c4931748f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:12:58 user nova-compute[71692]: No targets found.
Apr 13 19:12:58 user nova-compute[71692]: iSNS:
Apr 13 19:12:58 user nova-compute[71692]: No targets found.
Apr 13 19:12:58 user nova-compute[71692]: STATIC:
Apr 13 19:12:58 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7
Apr 13 19:12:58 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:12:58 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:12:58 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96
Apr 13 19:12:58 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:12:58 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:12:58 user nova-compute[71692]: FIRMWARE:
Apr 13 19:12:58 user nova-compute[71692]: No targets found.
Apr 13 19:12:58 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:12:58 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:12:58 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c606b87-2c47-462c-983c-55d76d56f8a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3385cf-e866-4a2b-a1ea-e40856e54143]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:12:58 user nova-compute[71692]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:12:58 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 (non-flash)
Apr 13 19:12:58 user nova-compute[71692]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:12:58 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febd8b357e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96'): ({'sdb'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Removing single pathed devices sdb {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[845348d6-c393-44b5-bc79-826d3c33ff15]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b079c7a-1fe1-45e0-b1ab-732a509837b0]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Flushing IO for device /dev/sdb {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e4ec8c-506e-4de1-aeb5-d443461510d7]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b0f13e-447c-46f7-b8a6-8d7e8662b4c0]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ff1c01-cb2d-4c4f-99a4-31b642931588]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e224218-92df-4244-bc67-a05e4ddc967a]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96, portal: 172.16.0.220,3260]
Apr 13 19:12:58 user nova-compute[71692]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96, portal: 172.16.0.220,3260] successful.
Apr 13 19:12:58 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4247891-9834-4568-b6a1-dc01fb328ee0]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] <== disconnect_volume: return (319ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:12:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:12:58 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Deleting instance files /opt/stack/data/nova/instances/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333_del
Apr 13 19:12:58 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Deletion of /opt/stack/data/nova/instances/8c60e6c0-533c-4fd3-938f-b9ecc9fb0333_del complete
Apr 13 19:12:59 user nova-compute[71692]: INFO nova.compute.manager [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Took 1.77 seconds to destroy the instance on the hypervisor.
Apr 13 19:12:59 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:12:59 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:12:59 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:12:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received event network-vif-unplugged-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:12:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] Acquiring lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] No waiting events found dispatching network-vif-unplugged-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:12:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received event network-vif-unplugged-8640b481-7480-494b-a88b-e21419d695cf for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:12:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received event network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:12:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] Acquiring lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:12:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:12:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:12:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] No waiting events found dispatching network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:12:59 user nova-compute[71692]: WARNING nova.compute.manager [req-afa72958-068a-441a-a83d-cd8d68a3a140 req-6ac8440a-a8ad-4ab3-b922-2565b5254218 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received unexpected event network-vif-plugged-8640b481-7480-494b-a88b-e21419d695cf for instance with vm_state active and task_state deleting.
Apr 13 19:12:59 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:12:59 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Took 0.48 seconds to deallocate network for instance.
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-84851da0-0cab-4eb1-97b0-3fc8e1eec12e req-4a774ab6-5acd-4e15-ad50-b7c29e015218 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Received event network-vif-plugged-a29956b4-c9c2-4c86-bf4a-488fb5f45af0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-84851da0-0cab-4eb1-97b0-3fc8e1eec12e req-4a774ab6-5acd-4e15-ad50-b7c29e015218 service nova] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-84851da0-0cab-4eb1-97b0-3fc8e1eec12e req-4a774ab6-5acd-4e15-ad50-b7c29e015218 service nova] Lock "080204b2-fd4d-4224-b391-a27036d058ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-84851da0-0cab-4eb1-97b0-3fc8e1eec12e req-4a774ab6-5acd-4e15-ad50-b7c29e015218 service nova] Lock "080204b2-fd4d-4224-b391-a27036d058ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-84851da0-0cab-4eb1-97b0-3fc8e1eec12e req-4a774ab6-5acd-4e15-ad50-b7c29e015218 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] No waiting events found dispatching network-vif-plugged-a29956b4-c9c2-4c86-bf4a-488fb5f45af0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:13:00 user nova-compute[71692]: WARNING nova.compute.manager [req-84851da0-0cab-4eb1-97b0-3fc8e1eec12e req-4a774ab6-5acd-4e15-ad50-b7c29e015218 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Received unexpected event network-vif-plugged-a29956b4-c9c2-4c86-bf4a-488fb5f45af0 for instance with vm_state building and task_state spawning.
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-84851da0-0cab-4eb1-97b0-3fc8e1eec12e req-4a774ab6-5acd-4e15-ad50-b7c29e015218 service nova] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Received event network-vif-deleted-8640b481-7480-494b-a88b-e21419d695cf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.compute.manager [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413180.4769356, 080204b2-fd4d-4224-b391-a27036d058ac => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:13:00 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] VM Resumed (Lifecycle Event)
Apr 13 19:13:00 user nova-compute[71692]: INFO nova.compute.manager [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Took 0.94 seconds to detach 1 volumes for instance.
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.compute.manager [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Deleting volume: c8ba48b2-bc09-4cfc-b8e9-49603f9d1f96 {{(pid=71692) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:13:00 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Instance spawned successfully.
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:00 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413180.4825904, 080204b2-fd4d-4224-b391-a27036d058ac => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:13:00 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] VM Started (Lifecycle Event)
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:13:00 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:13:00 user nova-compute[71692]: INFO nova.compute.manager [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Took 6.42 seconds to spawn the instance on the hypervisor.
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.compute.manager [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:00 user nova-compute[71692]: INFO nova.compute.manager [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Took 7.12 seconds to build instance.
Apr 13 19:13:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30ec9be8-2bc9-40e9-b1c5-9b48ea5d2a81 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.260s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:00 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:13:01 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:13:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:01 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Deleted allocations for instance 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333
Apr 13 19:13:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-675301f3-7a3d-4fc9-9c21-62e46c3ff6e3 tempest-TestShelveInstance-1512441304 tempest-TestShelveInstance-1512441304-project-member] Lock "8c60e6c0-533c-4fd3-938f-b9ecc9fb0333" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.870s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-17187ffc-8e22-4d64-8581-ffda32f17445 req-7763f4d4-5865-40c0-9b60-8fbfc8dd47b1 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Received event network-changed-ab959649-556a-479c-9e13-ec36fb9ebb66 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:13:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-17187ffc-8e22-4d64-8581-ffda32f17445 req-7763f4d4-5865-40c0-9b60-8fbfc8dd47b1 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Refreshing instance network info cache due to event network-changed-ab959649-556a-479c-9e13-ec36fb9ebb66. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:13:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-17187ffc-8e22-4d64-8581-ffda32f17445 req-7763f4d4-5865-40c0-9b60-8fbfc8dd47b1 service nova] Acquiring lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:13:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-17187ffc-8e22-4d64-8581-ffda32f17445 req-7763f4d4-5865-40c0-9b60-8fbfc8dd47b1 service nova] Acquired lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:13:01 user nova-compute[71692]: DEBUG nova.network.neutron [req-17187ffc-8e22-4d64-8581-ffda32f17445 req-7763f4d4-5865-40c0-9b60-8fbfc8dd47b1 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Refreshing network info cache for port ab959649-556a-479c-9e13-ec36fb9ebb66 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:13:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1d7439c2-317e-4454-905f-dc8e59bc49e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1d7439c2-317e-4454-905f-dc8e59bc49e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:01 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:13:02 user nova-compute[71692]: INFO nova.compute.claims [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Claim successful on node user
Apr 13 19:13:02 user nova-compute[71692]: DEBUG nova.network.neutron [req-17187ffc-8e22-4d64-8581-ffda32f17445 req-7763f4d4-5865-40c0-9b60-8fbfc8dd47b1 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Updated VIF entry in instance network info cache for port ab959649-556a-479c-9e13-ec36fb9ebb66. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG nova.network.neutron [req-17187ffc-8e22-4d64-8581-ffda32f17445 req-7763f4d4-5865-40c0-9b60-8fbfc8dd47b1 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Updating instance_info_cache with network_info: [{"id": "ab959649-556a-479c-9e13-ec36fb9ebb66", "address": "fa:16:3e:4b:6d:5f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab959649-55", "ovs_interfaceid": "ab959649-556a-479c-9e13-ec36fb9ebb66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-17187ffc-8e22-4d64-8581-ffda32f17445 req-7763f4d4-5865-40c0-9b60-8fbfc8dd47b1 service nova] Releasing lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG nova.network.neutron [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:13:02 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:13:02 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG nova.policy [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '975d5fe9f1e445f0ba1be8fc71e93ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc458426af4ea2b4bbcfdf9b4fe041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:13:02 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Creating image(s)
Apr 13 19:13:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "/opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "/opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.154s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk 1073741824" returned: 0 in 0.049s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.157s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:03 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:13:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:03 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Cannot resize image /opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:13:03 user nova-compute[71692]: DEBUG nova.objects.instance [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'migration_context' on Instance uuid 1d7439c2-317e-4454-905f-dc8e59bc49e8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:13:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:13:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Ensure instance console log exists: /opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:13:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:03 user nova-compute[71692]: DEBUG nova.network.neutron [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Successfully created port: 2df65aa5-af8b-4d51-8246-ed31a3e0219e {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:13:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.network.neutron [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Successfully updated port: 2df65aa5-af8b-4d51-8246-ed31a3e0219e {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "refresh_cache-1d7439c2-317e-4454-905f-dc8e59bc49e8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquired lock "refresh_cache-1d7439c2-317e-4454-905f-dc8e59bc49e8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.network.neutron [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-596a3ed3-3d23-43d3-a2e4-7d9e7c3bc168 req-04310ef1-8d6d-4861-87ff-51ec675b3d22 service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Received event network-changed-2df65aa5-af8b-4d51-8246-ed31a3e0219e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-596a3ed3-3d23-43d3-a2e4-7d9e7c3bc168 req-04310ef1-8d6d-4861-87ff-51ec675b3d22 service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Refreshing instance network info cache due to event network-changed-2df65aa5-af8b-4d51-8246-ed31a3e0219e. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-596a3ed3-3d23-43d3-a2e4-7d9e7c3bc168 req-04310ef1-8d6d-4861-87ff-51ec675b3d22 service nova] Acquiring lock "refresh_cache-1d7439c2-317e-4454-905f-dc8e59bc49e8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.network.neutron [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.network.neutron [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Updating instance_info_cache with network_info: [{"id": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "address": "fa:16:3e:62:30:18", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df65aa5-af", "ovs_interfaceid": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Releasing lock "refresh_cache-1d7439c2-317e-4454-905f-dc8e59bc49e8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Instance network_info: |[{"id": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "address": "fa:16:3e:62:30:18", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df65aa5-af", "ovs_interfaceid": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-596a3ed3-3d23-43d3-a2e4-7d9e7c3bc168 req-04310ef1-8d6d-4861-87ff-51ec675b3d22 service nova] Acquired lock "refresh_cache-1d7439c2-317e-4454-905f-dc8e59bc49e8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.network.neutron [req-596a3ed3-3d23-43d3-a2e4-7d9e7c3bc168 req-04310ef1-8d6d-4861-87ff-51ec675b3d22 service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Refreshing network info cache for port 2df65aa5-af8b-4d51-8246-ed31a3e0219e {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Start _get_guest_xml network_info=[{"id": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "address": "fa:16:3e:62:30:18", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df65aa5-af", "ovs_interfaceid": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:13:04 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:13:04 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:13:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1026578346',display_name='tempest-AttachVolumeNegativeTest-server-1026578346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1026578346',id=28,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvx+NdVaRzGRxiQY+XYoIW6YuPWvMsgN7CXZ0pBdpM8XxJvUcI0Aw9ztA/htv8tlmF0ErI6crkAH0Uw9JA9IEn3VjvSl6uTMrNFJqI5sjQP4v1MscAIBS4R6Qf+HcOgZQ==',key_name='tempest-keypair-701851917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dcc458426af4ea2b4bbcfdf9b4fe041',ramdisk_id='',reservation_id='r-qr8d0680',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-513091417',owner_user_name='tempest-AttachVolumeNegativeTest-513091417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:13:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975d5fe9f1e445f0ba1be8fc71e93ecc',uuid=1d7439c2-317e-4454-905f-dc8e59bc49e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "address": "fa:16:3e:62:30:18", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df65aa5-af", "ovs_interfaceid": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converting VIF {"id": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "address": "fa:16:3e:62:30:18", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df65aa5-af", "ovs_interfaceid": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:30:18,bridge_name='br-int',has_traffic_filtering=True,id=2df65aa5-af8b-4d51-8246-ed31a3e0219e,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df65aa5-af') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.objects.instance [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d7439c2-317e-4454-905f-dc8e59bc49e8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:13:04 user nova-compute[71692]:   <uuid>1d7439c2-317e-4454-905f-dc8e59bc49e8</uuid>
Apr 13 19:13:04 user nova-compute[71692]:   <name>instance-0000001c</name>
Apr 13 19:13:04 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:13:04 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:13:04 user nova-compute[71692]:   <metadata>
Apr 13 19:13:04 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:13:04 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:13:04 user nova-compute[71692]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1026578346</nova:name>
Apr 13 19:13:04 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:13:04</nova:creationTime>
Apr 13 19:13:04 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:13:04 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:13:04 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:13:04 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:13:04 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:13:04 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:13:04 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:13:04 user nova-compute[71692]:       <nova:owner>
Apr 13 19:13:04 user nova-compute[71692]:         <nova:user uuid="975d5fe9f1e445f0ba1be8fc71e93ecc">tempest-AttachVolumeNegativeTest-513091417-project-member</nova:user>
Apr 13 19:13:04 user nova-compute[71692]:         <nova:project uuid="0dcc458426af4ea2b4bbcfdf9b4fe041">tempest-AttachVolumeNegativeTest-513091417</nova:project>
Apr 13 19:13:04 user nova-compute[71692]:       </nova:owner>
Apr 13 19:13:04 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:13:04 user nova-compute[71692]:       <nova:ports>
Apr 13 19:13:04 user nova-compute[71692]:         <nova:port uuid="2df65aa5-af8b-4d51-8246-ed31a3e0219e">
Apr 13 19:13:04 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 19:13:04 user nova-compute[71692]:         </nova:port>
Apr 13 19:13:04 user nova-compute[71692]:       </nova:ports>
Apr 13 19:13:04 user nova-compute[71692]:     </nova:instance>
Apr 13 19:13:04 user nova-compute[71692]:   </metadata>
Apr 13 19:13:04 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:13:04 user nova-compute[71692]:     <system>
Apr 13 19:13:04 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:13:04 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:13:04 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:13:04 user nova-compute[71692]:       <entry name="serial">1d7439c2-317e-4454-905f-dc8e59bc49e8</entry>
Apr 13 19:13:04 user nova-compute[71692]:       <entry name="uuid">1d7439c2-317e-4454-905f-dc8e59bc49e8</entry>
Apr 13 19:13:04 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:13:04 user nova-compute[71692]:     </system>
Apr 13 19:13:04 user nova-compute[71692]:   </sysinfo>
Apr 13 19:13:04 user nova-compute[71692]:   <os>
Apr 13 19:13:04 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:13:04 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:13:04 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:13:04 user nova-compute[71692]:   </os>
Apr 13 19:13:04 user nova-compute[71692]:   <features>
Apr 13 19:13:04 user nova-compute[71692]:     <acpi/>
Apr 13 19:13:04 user nova-compute[71692]:     <apic/>
Apr 13 19:13:04 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:13:04 user nova-compute[71692]:   </features>
Apr 13 19:13:04 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:13:04 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:13:04 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:13:04 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:13:04 user nova-compute[71692]:   </clock>
Apr 13 19:13:04 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:13:04 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:13:04 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:13:04 user nova-compute[71692]:   </cpu>
Apr 13 19:13:04 user nova-compute[71692]:   <devices>
Apr 13 19:13:04 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:13:04 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:13:04 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk"/>
Apr 13 19:13:04 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:13:04 user nova-compute[71692]:     </disk>
Apr 13 19:13:04 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:13:04 user nova-compute[71692]:       <mac address="fa:16:3e:62:30:18"/>
Apr 13 19:13:04 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:13:04 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:13:04 user nova-compute[71692]:       <target dev="tap2df65aa5-af"/>
Apr 13 19:13:04 user nova-compute[71692]:     </interface>
Apr 13 19:13:04 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:13:04 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/console.log" append="off"/>
Apr 13 19:13:04 user nova-compute[71692]:     </serial>
Apr 13 19:13:04 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:13:04 user nova-compute[71692]:     <video>
Apr 13 19:13:04 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:13:04 user nova-compute[71692]:     </video>
Apr 13 19:13:04 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:13:04 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:13:04 user nova-compute[71692]:     </rng>
Apr 13 19:13:04 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:13:04 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:13:04 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:13:04 user nova-compute[71692]:     </memballoon>
Apr 13 19:13:04 user nova-compute[71692]:   </devices>
Apr 13 19:13:04 user nova-compute[71692]: </domain>
Apr 13 19:13:04 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:13:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1026578346',display_name='tempest-AttachVolumeNegativeTest-server-1026578346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1026578346',id=28,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvx+NdVaRzGRxiQY+XYoIW6YuPWvMsgN7CXZ0pBdpM8XxJvUcI0Aw9ztA/htv8tlmF0ErI6crkAH0Uw9JA9IEn3VjvSl6uTMrNFJqI5sjQP4v1MscAIBS4R6Qf+HcOgZQ==',key_name='tempest-keypair-701851917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dcc458426af4ea2b4bbcfdf9b4fe041',ramdisk_id='',reservation_id='r-qr8d0680',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-513091417',owner_user_name='tempest-AttachVolumeNegativeTest-513091417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:13:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975d5fe9f1e445f0ba1be8fc71e93ecc',uuid=1d7439c2-317e-4454-905f-dc8e59bc49e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "address": "fa:16:3e:62:30:18", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df65aa5-af", "ovs_interfaceid": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converting VIF {"id": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "address": "fa:16:3e:62:30:18", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df65aa5-af", "ovs_interfaceid": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:30:18,bridge_name='br-int',has_traffic_filtering=True,id=2df65aa5-af8b-4d51-8246-ed31a3e0219e,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df65aa5-af') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG os_vif [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:30:18,bridge_name='br-int',has_traffic_filtering=True,id=2df65aa5-af8b-4d51-8246-ed31a3e0219e,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df65aa5-af') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2df65aa5-af, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2df65aa5-af, col_values=(('external_ids', {'iface-id': '2df65aa5-af8b-4d51-8246-ed31a3e0219e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:30:18', 'vm-uuid': '1d7439c2-317e-4454-905f-dc8e59bc49e8'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:04 user nova-compute[71692]: INFO os_vif [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:30:18,bridge_name='br-int',has_traffic_filtering=True,id=2df65aa5-af8b-4d51-8246-ed31a3e0219e,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df65aa5-af')
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:13:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] No VIF found with MAC fa:16:3e:62:30:18, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG nova.network.neutron [req-596a3ed3-3d23-43d3-a2e4-7d9e7c3bc168 req-04310ef1-8d6d-4861-87ff-51ec675b3d22 service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Updated VIF entry in instance network info cache for port 2df65aa5-af8b-4d51-8246-ed31a3e0219e. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG nova.network.neutron [req-596a3ed3-3d23-43d3-a2e4-7d9e7c3bc168 req-04310ef1-8d6d-4861-87ff-51ec675b3d22 service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Updating instance_info_cache with network_info: [{"id": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "address": "fa:16:3e:62:30:18", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df65aa5-af", "ovs_interfaceid": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-596a3ed3-3d23-43d3-a2e4-7d9e7c3bc168 req-04310ef1-8d6d-4861-87ff-51ec675b3d22 service nova] Releasing lock "refresh_cache-1d7439c2-317e-4454-905f-dc8e59bc49e8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "a9f3d080-a163-4897-9187-2687cae49694" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:13:05 user nova-compute[71692]: INFO nova.compute.claims [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Claim successful on node user
Apr 13 19:13:05 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:13:05 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:13:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG nova.policy [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df209814208d415e9d414d39205aaad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c162f91cba4b4ecf9de48fbf839da261', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:13:05 user nova-compute[71692]: INFO nova.virt.block_device [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Booting with volume 7cde3ec4-f279-44f2-927c-45ce0d350ca2 at /dev/vda
Apr 13 19:13:05 user nova-compute[71692]: DEBUG os_brick.utils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad7dc49-d0a6-42e4-a2a1-9cb351cc3384]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e6e689-f723-4465-9223-e5e647f3622a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[74029725-59d6-468e-99df-105832aeff3d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed12c29-c3ba-496a-9e09-6deefa8ba528]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:13:05 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:13:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a4e1b0-98b6-4b6e-af0e-8745202eb388]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG os_brick.utils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:13:05 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Updating existing volume attachment record: a70451a2-9e06-437a-907a-a7d693cc7e11 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:13:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-41d9fbfe-b0d7-464c-8a14-88de85d1f1e1 req-a4eb6a41-55d0-4a54-a08e-1d66908622be service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Received event network-vif-plugged-2df65aa5-af8b-4d51-8246-ed31a3e0219e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:13:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-41d9fbfe-b0d7-464c-8a14-88de85d1f1e1 req-a4eb6a41-55d0-4a54-a08e-1d66908622be service nova] Acquiring lock "1d7439c2-317e-4454-905f-dc8e59bc49e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-41d9fbfe-b0d7-464c-8a14-88de85d1f1e1 req-a4eb6a41-55d0-4a54-a08e-1d66908622be service nova] Lock "1d7439c2-317e-4454-905f-dc8e59bc49e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-41d9fbfe-b0d7-464c-8a14-88de85d1f1e1 req-a4eb6a41-55d0-4a54-a08e-1d66908622be service nova] Lock "1d7439c2-317e-4454-905f-dc8e59bc49e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-41d9fbfe-b0d7-464c-8a14-88de85d1f1e1 req-a4eb6a41-55d0-4a54-a08e-1d66908622be service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] No waiting events found dispatching network-vif-plugged-2df65aa5-af8b-4d51-8246-ed31a3e0219e {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:13:06 user nova-compute[71692]: WARNING nova.compute.manager [req-41d9fbfe-b0d7-464c-8a14-88de85d1f1e1 req-a4eb6a41-55d0-4a54-a08e-1d66908622be service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Received unexpected event network-vif-plugged-2df65aa5-af8b-4d51-8246-ed31a3e0219e for instance with vm_state building and task_state spawning.
Apr 13 19:13:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:06 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Successfully created port: 2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:13:07 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Successfully updated port: 2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:13:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:13:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquired lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:13:07 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:13:07 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:13:07 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Updating instance_info_cache with network_info: [{"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Releasing lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Instance network_info: |[{"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413188.2852972, 1d7439c2-317e-4454-905f-dc8e59bc49e8 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:13:08 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] VM Resumed (Lifecycle Event)
Apr 13 19:13:08 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Instance spawned successfully.
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:08 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413188.2865057, 1d7439c2-317e-4454-905f-dc8e59bc49e8 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:13:08 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] VM Started (Lifecycle Event)
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:13:08 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:13:08 user nova-compute[71692]: INFO nova.compute.manager [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Took 5.74 seconds to spawn the instance on the hypervisor.
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.compute.manager [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Received event network-vif-plugged-2df65aa5-af8b-4d51-8246-ed31a3e0219e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] Acquiring lock "1d7439c2-317e-4454-905f-dc8e59bc49e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] Lock "1d7439c2-317e-4454-905f-dc8e59bc49e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] Lock "1d7439c2-317e-4454-905f-dc8e59bc49e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.compute.manager [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] No waiting events found dispatching network-vif-plugged-2df65aa5-af8b-4d51-8246-ed31a3e0219e {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:13:08 user nova-compute[71692]: WARNING nova.compute.manager [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Received unexpected event network-vif-plugged-2df65aa5-af8b-4d51-8246-ed31a3e0219e for instance with vm_state building and task_state spawning.
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.compute.manager [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received event network-changed-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.compute.manager [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Refreshing instance network info cache due to event network-changed-2207b77c-fc08-471c-8281-cd1f6061ea54. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] Acquiring lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] Acquired lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.network.neutron [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Refreshing network info cache for port 2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:13:08 user nova-compute[71692]: INFO nova.compute.manager [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Took 6.53 seconds to build instance.
Apr 13 19:13:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b13632d3-5812-48ea-b5ec-d72affdc9e17 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1d7439c2-317e-4454-905f-dc8e59bc49e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.664s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.network.neutron [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Updated VIF entry in instance network info cache for port 2207b77c-fc08-471c-8281-cd1f6061ea54. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG nova.network.neutron [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Updating instance_info_cache with network_info: [{"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:13:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-363cd77a-245a-4448-9208-dd8c75d1748d req-7649d5a3-40b6-4f85-af8e-d6c5932d3647 service nova] Releasing lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:13:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:13:10 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Creating image(s)
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Did not create local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Ensure instance console log exists: /opt/stack/data/nova/instances/a9f3d080-a163-4897-9187-2687cae49694/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Start _get_guest_xml network_info=[{"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'a70451a2-9e06-437a-907a-a7d693cc7e11', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTPAhqcO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a9f3d080-a163-4897-9187-2687cae49694', 'attached_at': '', 'detached_at': '', 'volume_id': '7cde3ec4-f279-44f2-927c-45ce0d350ca2', 'serial': '7cde3ec4-f279-44f2-927c-45ce0d350ca2'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:13:10 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:13:10 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTPAhqcO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:13:10 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:13:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:13:10 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:13:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:13:10 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:13:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0297fe68-a019-491b-80ae-a0a9cb4af425]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:13:10 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[968bfd67-5263-47e7-9ba9-a2d98f844e18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2] added
Apr 13 19:13:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf56d77-453f-40df-89b4-d9181e6d4976]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ab4c46-4a18-4ffe-bbad-c72a9854a3e4]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTPAhqcO {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTPAhqcO" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77ab25b-9ce8-4770-a144-1418d60ec2d9]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UTPAhqcO'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8cc3c8-c632-4b64-aef6-535219639475]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e60b54c-f588-4061-848d-8f7bbe98baee]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:13:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:13:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd5cc8e-c488-4898-824a-c5856ed4a26d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2, portal: 172.16.0.220,3260]
Apr 13 19:13:11 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2, portal: 172.16.0.220,3260] successful.
Apr 13 19:13:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a056e20-0b8b-4144-8800-940040aa67a8]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c163b9e2-3dc7-4f82-bd4d-c532d4beeb6b]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:13:11 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:13:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:13:11 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:13:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e3649a-5275-423f-adf5-a1f2feb31f43]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTPAhqcO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:13:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23935373435633432', 'path': '/dev/sdb'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935373435633432', 'path': '/dev/sdb'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1898726378',display_name='tempest-ServerActionsTestJSON-server-1898726378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1898726378',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-z4fn11mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:13:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=a9f3d080-a163-4897-9187-2687cae49694,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=2207b77c-fc08-471c-8281-cd1f6061ea54,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2207b77c-fc') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'pci_devices' on Instance uuid a9f3d080-a163-4897-9187-2687cae49694 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:13:12 user nova-compute[71692]:   <uuid>a9f3d080-a163-4897-9187-2687cae49694</uuid>
Apr 13 19:13:12 user nova-compute[71692]:   <name>instance-0000001d</name>
Apr 13 19:13:12 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:13:12 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:13:12 user nova-compute[71692]:   <metadata>
Apr 13 19:13:12 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:13:12 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:13:12 user nova-compute[71692]:       <nova:name>tempest-ServerActionsTestJSON-server-1898726378</nova:name>
Apr 13 19:13:12 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:13:10</nova:creationTime>
Apr 13 19:13:12 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:13:12 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:13:12 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:13:12 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:13:12 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:13:12 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:13:12 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:13:12 user nova-compute[71692]:       <nova:owner>
Apr 13 19:13:12 user nova-compute[71692]:         <nova:user uuid="df209814208d415e9d414d39205aaad6">tempest-ServerActionsTestJSON-1901931474-project-member</nova:user>
Apr 13 19:13:12 user nova-compute[71692]:         <nova:project uuid="c162f91cba4b4ecf9de48fbf839da261">tempest-ServerActionsTestJSON-1901931474</nova:project>
Apr 13 19:13:12 user nova-compute[71692]:       </nova:owner>
Apr 13 19:13:12 user nova-compute[71692]:       <nova:ports>
Apr 13 19:13:12 user nova-compute[71692]:         <nova:port uuid="2207b77c-fc08-471c-8281-cd1f6061ea54">
Apr 13 19:13:12 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 19:13:12 user nova-compute[71692]:         </nova:port>
Apr 13 19:13:12 user nova-compute[71692]:       </nova:ports>
Apr 13 19:13:12 user nova-compute[71692]:     </nova:instance>
Apr 13 19:13:12 user nova-compute[71692]:   </metadata>
Apr 13 19:13:12 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:13:12 user nova-compute[71692]:     <system>
Apr 13 19:13:12 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:13:12 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:13:12 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:13:12 user nova-compute[71692]:       <entry name="serial">a9f3d080-a163-4897-9187-2687cae49694</entry>
Apr 13 19:13:12 user nova-compute[71692]:       <entry name="uuid">a9f3d080-a163-4897-9187-2687cae49694</entry>
Apr 13 19:13:12 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:13:12 user nova-compute[71692]:     </system>
Apr 13 19:13:12 user nova-compute[71692]:   </sysinfo>
Apr 13 19:13:12 user nova-compute[71692]:   <os>
Apr 13 19:13:12 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:13:12 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:13:12 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:13:12 user nova-compute[71692]:   </os>
Apr 13 19:13:12 user nova-compute[71692]:   <features>
Apr 13 19:13:12 user nova-compute[71692]:     <acpi/>
Apr 13 19:13:12 user nova-compute[71692]:     <apic/>
Apr 13 19:13:12 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:13:12 user nova-compute[71692]:   </features>
Apr 13 19:13:12 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:13:12 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:13:12 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:13:12 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:13:12 user nova-compute[71692]:   </clock>
Apr 13 19:13:12 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:13:12 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:13:12 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:13:12 user nova-compute[71692]:   </cpu>
Apr 13 19:13:12 user nova-compute[71692]:   <devices>
Apr 13 19:13:12 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:13:12 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:13:12 user nova-compute[71692]:       <source dev="/dev/sdb"/>
Apr 13 19:13:12 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:13:12 user nova-compute[71692]:       <serial>7cde3ec4-f279-44f2-927c-45ce0d350ca2</serial>
Apr 13 19:13:12 user nova-compute[71692]:     </disk>
Apr 13 19:13:12 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:13:12 user nova-compute[71692]:       <mac address="fa:16:3e:7b:c7:2f"/>
Apr 13 19:13:12 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:13:12 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:13:12 user nova-compute[71692]:       <target dev="tap2207b77c-fc"/>
Apr 13 19:13:12 user nova-compute[71692]:     </interface>
Apr 13 19:13:12 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:13:12 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/a9f3d080-a163-4897-9187-2687cae49694/console.log" append="off"/>
Apr 13 19:13:12 user nova-compute[71692]:     </serial>
Apr 13 19:13:12 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:13:12 user nova-compute[71692]:     <video>
Apr 13 19:13:12 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:13:12 user nova-compute[71692]:     </video>
Apr 13 19:13:12 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:13:12 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:13:12 user nova-compute[71692]:     </rng>
Apr 13 19:13:12 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:13:12 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:13:12 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:13:12 user nova-compute[71692]:     </memballoon>
Apr 13 19:13:12 user nova-compute[71692]:   </devices>
Apr 13 19:13:12 user nova-compute[71692]: </domain>
Apr 13 19:13:12 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1898726378',display_name='tempest-ServerActionsTestJSON-server-1898726378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1898726378',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-z4fn11mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:13:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=a9f3d080-a163-4897-9187-2687cae49694,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=2207b77c-fc08-471c-8281-cd1f6061ea54,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2207b77c-fc') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG os_vif [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=2207b77c-fc08-471c-8281-cd1f6061ea54,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2207b77c-fc') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2207b77c-fc, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2207b77c-fc, col_values=(('external_ids', {'iface-id': '2207b77c-fc08-471c-8281-cd1f6061ea54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:c7:2f', 'vm-uuid': 'a9f3d080-a163-4897-9187-2687cae49694'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:12 user nova-compute[71692]: INFO os_vif [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=2207b77c-fc08-471c-8281-cd1f6061ea54,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2207b77c-fc')
Apr 13 19:13:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:13:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No VIF found with MAC fa:16:3e:7b:c7:2f, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "33367b19-4d62-46dc-8346-45ea09c5563d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lazy-loading 'flavor' on Instance uuid 33367b19-4d62-46dc-8346-45ea09c5563d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "33367b19-4d62-46dc-8346-45ea09c5563d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413178.6038096, 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:13:13 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] VM Stopped (Lifecycle Event)
Apr 13 19:13:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-cfe64582-db40-4dd5-8491-415692e10e5d None None] [instance: 8c60e6c0-533c-4fd3-938f-b9ecc9fb0333] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "33367b19-4d62-46dc-8346-45ea09c5563d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:13 user nova-compute[71692]: INFO nova.compute.manager [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Attaching volume ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 to /dev/vdb
Apr 13 19:13:13 user nova-compute[71692]: DEBUG os_brick.utils [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ac2b2e-8c9a-41eb-aad8-29d51b30f8a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0d6843-f647-4321-b994-df0edd0b789a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b9290c-ce5c-4e24-8805-d75ce79287a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd2e24e-d022-4537-8067-7cf268666b19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:13:14 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:13:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-b0b549b9-edd5-4327-ae1d-dbf30a812641 req-578cd6f5-4dd8-4e20-804d-820b0021b919 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:13:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b0b549b9-edd5-4327-ae1d-dbf30a812641 req-578cd6f5-4dd8-4e20-804d-820b0021b919 service nova] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b0b549b9-edd5-4327-ae1d-dbf30a812641 req-578cd6f5-4dd8-4e20-804d-820b0021b919 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b0b549b9-edd5-4327-ae1d-dbf30a812641 req-578cd6f5-4dd8-4e20-804d-820b0021b919 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-b0b549b9-edd5-4327-ae1d-dbf30a812641 req-578cd6f5-4dd8-4e20-804d-820b0021b919 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] No waiting events found dispatching network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:13:14 user nova-compute[71692]: WARNING nova.compute.manager [req-b0b549b9-edd5-4327-ae1d-dbf30a812641 req-578cd6f5-4dd8-4e20-804d-820b0021b919 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received unexpected event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 for instance with vm_state building and task_state spawning.
Apr 13 19:13:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:13:14 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:13:14 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d942e4a-d32f-45c2-b84f-92c69a11abb3]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:14 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:13:14 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:13:14 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:13:14 user nova-compute[71692]: DEBUG os_brick.utils [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:13:14 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Updating existing volume attachment record: 41c828e7-221a-4de3-80ab-bacc96d8acc3 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:13:15 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413195.8955243, a9f3d080-a163-4897-9187-2687cae49694 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:13:15 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] VM Resumed (Lifecycle Event)
Apr 13 19:13:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:13:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:13:15 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: a9f3d080-a163-4897-9187-2687cae49694] Instance spawned successfully.
Apr 13 19:13:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:13:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:13:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:13:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:15 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:13:15 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413195.9054637, a9f3d080-a163-4897-9187-2687cae49694 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:13:15 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] VM Started (Lifecycle Event)
Apr 13 19:13:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:13:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:13:16 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:13:16 user nova-compute[71692]: INFO nova.compute.manager [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Took 5.12 seconds to spawn the instance on the hypervisor.
Apr 13 19:13:16 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:13:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-ccb2e602-1a5c-47d0-8b00-3b92d29cf296 req-08414d24-3a72-4626-a922-7e907d843f43 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:13:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ccb2e602-1a5c-47d0-8b00-3b92d29cf296 req-08414d24-3a72-4626-a922-7e907d843f43 service nova] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ccb2e602-1a5c-47d0-8b00-3b92d29cf296 req-08414d24-3a72-4626-a922-7e907d843f43 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ccb2e602-1a5c-47d0-8b00-3b92d29cf296 req-08414d24-3a72-4626-a922-7e907d843f43 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-ccb2e602-1a5c-47d0-8b00-3b92d29cf296 req-08414d24-3a72-4626-a922-7e907d843f43 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] No waiting events found dispatching network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:13:16 user nova-compute[71692]: WARNING nova.compute.manager [req-ccb2e602-1a5c-47d0-8b00-3b92d29cf296 req-08414d24-3a72-4626-a922-7e907d843f43 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received unexpected event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 for instance with vm_state building and task_state spawning.
Apr 13 19:13:16 user nova-compute[71692]: INFO nova.compute.manager [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Took 10.92 seconds to build instance.
Apr 13 19:13:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e5a323eb-2fb3-4176-a041-d522f126711d tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "a9f3d080-a163-4897-9187-2687cae49694" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.007s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAXCiaRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:13:18 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:13:18 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:13:18 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6099a4-db2f-4356-b3ef-aa18fdf59e98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:13:18 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0ac022-2055-43b7-b2ee-d7b2bc520109]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185] added
Apr 13 19:13:18 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df8d140-833e-465c-b04e-26a184fa0437]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20e1476-d024-4d48-8916-bf6de47571d8]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NAXCiaRg {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NAXCiaRg" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f0cc55-8414-42bd-ab82-47b355709b39]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NAXCiaRg'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f21689-7221-4117-b9ac-356b1ec4a235]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a83f933-e189-48f6-a190-bd6bb22f62d3]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:13:18 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:13:18 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:13:18 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:13:18 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef614b67-9fd5-4412-bf42-a40e7056f72c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185, portal: 172.16.0.220,3260]
Apr 13 19:13:18 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185, portal: 172.16.0.220,3260] successful.
Apr 13 19:13:18 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3370dded-b8c2-4f2f-997a-bf216b0c1548]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3983d7ba-5dbb-4e6a-8b1e-4694c803c989]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:13:18 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:13:18 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:13:18 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:13:18 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:13:18 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:13:18 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4935691-60e8-4c32-9960-546cb5df0d9a]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:13:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAXCiaRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:13:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:13:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23631313665303438', 'path': '/dev/sdd'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:13:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631313665303438', 'path': '/dev/sdd'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:13:19 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lazy-loading 'flavor' on Instance uuid 33367b19-4d62-46dc-8346-45ea09c5563d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:13:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:13:19 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:13:19 user nova-compute[71692]:   <source dev="/dev/sdd"/>
Apr 13 19:13:19 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:13:19 user nova-compute[71692]:   <serial>ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185</serial>
Apr 13 19:13:19 user nova-compute[71692]: </disk>
Apr 13 19:13:19 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:13:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:13:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:13:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] No VIF found with MAC fa:16:3e:ac:21:e1, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:13:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0906d5ea-f675-44b7-9071-2c97c8b6382e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "33367b19-4d62-46dc-8346-45ea09c5563d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.624s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "e9428f3f-1910-421d-be9c-7ca42fa46334" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "e9428f3f-1910-421d-be9c-7ca42fa46334" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:13:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:20 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:13:20 user nova-compute[71692]: INFO nova.compute.claims [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Claim successful on node user
Apr 13 19:13:20 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:13:20 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:13:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:13:21 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:13:21 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:13:21 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Creating image(s)
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "/opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "/opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.151s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG nova.policy [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80063ed703d24a1b84aede724db205a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2877676ccbd0484d80ecabf3030c0ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk 1073741824" returned: 0 in 0.057s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:21 user nova-compute[71692]: INFO nova.compute.manager [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Rescuing
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquired lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.149s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Cannot resize image /opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lazy-loading 'migration_context' on Instance uuid e9428f3f-1910-421d-be9c-7ca42fa46334 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Ensure instance console log exists: /opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:22 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Successfully created port: 06aa9cb5-cf77-482a-8292-b82631f08459 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:13:22 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Updating instance_info_cache with network_info: [{"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:13:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Releasing lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:13:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-ee086c6a-38b9-450e-96ab-a8ce7153c242 req-5bcd8fde-f070-4f09-90ee-2e3ec563c479 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-vif-unplugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:13:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ee086c6a-38b9-450e-96ab-a8ce7153c242 req-5bcd8fde-f070-4f09-90ee-2e3ec563c479 service nova] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ee086c6a-38b9-450e-96ab-a8ce7153c242 req-5bcd8fde-f070-4f09-90ee-2e3ec563c479 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ee086c6a-38b9-450e-96ab-a8ce7153c242 req-5bcd8fde-f070-4f09-90ee-2e3ec563c479 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-ee086c6a-38b9-450e-96ab-a8ce7153c242 req-5bcd8fde-f070-4f09-90ee-2e3ec563c479 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] No waiting events found dispatching network-vif-unplugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:13:22 user nova-compute[71692]: WARNING nova.compute.manager [req-ee086c6a-38b9-450e-96ab-a8ce7153c242 req-5bcd8fde-f070-4f09-90ee-2e3ec563c479 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received unexpected event network-vif-unplugged-6d1659d8-90f3-45a5-90a0-772abe02c673 for instance with vm_state active and task_state rescuing.
Apr 13 19:13:22 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Successfully updated port: 06aa9cb5-cf77-482a-8292-b82631f08459 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:13:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "refresh_cache-e9428f3f-1910-421d-be9c-7ca42fa46334" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:13:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquired lock "refresh_cache-e9428f3f-1910-421d-be9c-7ca42fa46334" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:13:23 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:13:23 user nova-compute[71692]: DEBUG nova.compute.manager [req-b4233070-f835-46d5-887b-7e0d090a9458 req-de3aea0c-7254-45fc-a277-c09f087c76f8 service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Received event network-changed-06aa9cb5-cf77-482a-8292-b82631f08459 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:13:23 user nova-compute[71692]: DEBUG nova.compute.manager [req-b4233070-f835-46d5-887b-7e0d090a9458 req-de3aea0c-7254-45fc-a277-c09f087c76f8 service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Refreshing instance network info cache due to event network-changed-06aa9cb5-cf77-482a-8292-b82631f08459. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:13:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b4233070-f835-46d5-887b-7e0d090a9458 req-de3aea0c-7254-45fc-a277-c09f087c76f8 service nova] Acquiring lock "refresh_cache-e9428f3f-1910-421d-be9c-7ca42fa46334" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:13:23 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:13:23 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Instance destroyed successfully.
Apr 13 19:13:23 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Attempting a stable device rescue
Apr 13 19:13:23 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71692) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 19:13:23 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Instance directory exists: not creating {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 19:13:23 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Creating image(s)
Apr 13 19:13:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "/opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "/opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "/opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:23 user nova-compute[71692]: DEBUG nova.objects.instance [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lazy-loading 'trusted_certs' on Instance uuid 33367b19-4d62-46dc-8346-45ea09c5563d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:13:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "ffc8830d176c3c93408bae1a1824785450ad5b4a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "ffc8830d176c3c93408bae1a1824785450ad5b4a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffc8830d176c3c93408bae1a1824785450ad5b4a.part --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffc8830d176c3c93408bae1a1824785450ad5b4a.part --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.images [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] 36e14854-8ca1-420d-8642-21ad4d51b5d6 was qcow2, converting to raw {{(pid=71692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.privsep.utils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ffc8830d176c3c93408bae1a1824785450ad5b4a.part /opt/stack/data/nova/instances/_base/ffc8830d176c3c93408bae1a1824785450ad5b4a.converted {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Updating instance_info_cache with network_info: [{"id": "06aa9cb5-cf77-482a-8292-b82631f08459", "address": "fa:16:3e:a5:da:5a", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa9cb5-cf", "ovs_interfaceid": "06aa9cb5-cf77-482a-8292-b82631f08459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Releasing lock "refresh_cache-e9428f3f-1910-421d-be9c-7ca42fa46334" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Instance network_info: |[{"id": "06aa9cb5-cf77-482a-8292-b82631f08459", "address": "fa:16:3e:a5:da:5a", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa9cb5-cf", "ovs_interfaceid": "06aa9cb5-cf77-482a-8292-b82631f08459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b4233070-f835-46d5-887b-7e0d090a9458 req-de3aea0c-7254-45fc-a277-c09f087c76f8 service nova] Acquired lock "refresh_cache-e9428f3f-1910-421d-be9c-7ca42fa46334" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.network.neutron [req-b4233070-f835-46d5-887b-7e0d090a9458 req-de3aea0c-7254-45fc-a277-c09f087c76f8 service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Refreshing network info cache for port 06aa9cb5-cf77-482a-8292-b82631f08459 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Start _get_guest_xml network_info=[{"id": "06aa9cb5-cf77-482a-8292-b82631f08459", "address": "fa:16:3e:a5:da:5a", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa9cb5-cf", "ovs_interfaceid": "06aa9cb5-cf77-482a-8292-b82631f08459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:13:24 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:13:24 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1162697425',display_name='tempest-VolumesActionsTest-instance-1162697425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1162697425',id=30,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2877676ccbd0484d80ecabf3030c0ee4',ramdisk_id='',reservation_id='r-6koo2yvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-427747232',owner_user_name='tempest-VolumesActionsTest-427747232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:13:21Z,user_data=None,user_id='80063ed703d24a1b84aede724db205a7',uuid=e9428f3f-1910-421d-be9c-7ca42fa46334,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06aa9cb5-cf77-482a-8292-b82631f08459", "address": "fa:16:3e:a5:da:5a", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa9cb5-cf", "ovs_interfaceid": "06aa9cb5-cf77-482a-8292-b82631f08459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Converting VIF {"id": "06aa9cb5-cf77-482a-8292-b82631f08459", "address": "fa:16:3e:a5:da:5a", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa9cb5-cf", "ovs_interfaceid": "06aa9cb5-cf77-482a-8292-b82631f08459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:da:5a,bridge_name='br-int',has_traffic_filtering=True,id=06aa9cb5-cf77-482a-8292-b82631f08459,network=Network(b34bf81f-6825-4376-a26c-35386631a4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aa9cb5-cf') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lazy-loading 'pci_devices' on Instance uuid e9428f3f-1910-421d-be9c-7ca42fa46334 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:13:24 user nova-compute[71692]:   <uuid>e9428f3f-1910-421d-be9c-7ca42fa46334</uuid>
Apr 13 19:13:24 user nova-compute[71692]:   <name>instance-0000001e</name>
Apr 13 19:13:24 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:13:24 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:13:24 user nova-compute[71692]:   <metadata>
Apr 13 19:13:24 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:13:24 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:13:24 user nova-compute[71692]:       <nova:name>tempest-VolumesActionsTest-instance-1162697425</nova:name>
Apr 13 19:13:24 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:13:24</nova:creationTime>
Apr 13 19:13:24 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:13:24 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:13:24 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:13:24 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:13:24 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:13:24 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:13:24 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:13:24 user nova-compute[71692]:       <nova:owner>
Apr 13 19:13:24 user nova-compute[71692]:         <nova:user uuid="80063ed703d24a1b84aede724db205a7">tempest-VolumesActionsTest-427747232-project-member</nova:user>
Apr 13 19:13:24 user nova-compute[71692]:         <nova:project uuid="2877676ccbd0484d80ecabf3030c0ee4">tempest-VolumesActionsTest-427747232</nova:project>
Apr 13 19:13:24 user nova-compute[71692]:       </nova:owner>
Apr 13 19:13:24 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:13:24 user nova-compute[71692]:       <nova:ports>
Apr 13 19:13:24 user nova-compute[71692]:         <nova:port uuid="06aa9cb5-cf77-482a-8292-b82631f08459">
Apr 13 19:13:24 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 19:13:24 user nova-compute[71692]:         </nova:port>
Apr 13 19:13:24 user nova-compute[71692]:       </nova:ports>
Apr 13 19:13:24 user nova-compute[71692]:     </nova:instance>
Apr 13 19:13:24 user nova-compute[71692]:   </metadata>
Apr 13 19:13:24 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:13:24 user nova-compute[71692]:     <system>
Apr 13 19:13:24 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:13:24 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:13:24 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:13:24 user nova-compute[71692]:       <entry name="serial">e9428f3f-1910-421d-be9c-7ca42fa46334</entry>
Apr 13 19:13:24 user nova-compute[71692]:       <entry name="uuid">e9428f3f-1910-421d-be9c-7ca42fa46334</entry>
Apr 13 19:13:24 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:13:24 user nova-compute[71692]:     </system>
Apr 13 19:13:24 user nova-compute[71692]:   </sysinfo>
Apr 13 19:13:24 user nova-compute[71692]:   <os>
Apr 13 19:13:24 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:13:24 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:13:24 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:13:24 user nova-compute[71692]:   </os>
Apr 13 19:13:24 user nova-compute[71692]:   <features>
Apr 13 19:13:24 user nova-compute[71692]:     <acpi/>
Apr 13 19:13:24 user nova-compute[71692]:     <apic/>
Apr 13 19:13:24 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:13:24 user nova-compute[71692]:   </features>
Apr 13 19:13:24 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:13:24 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:13:24 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:13:24 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:13:24 user nova-compute[71692]:   </clock>
Apr 13 19:13:24 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:13:24 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:13:24 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:13:24 user nova-compute[71692]:   </cpu>
Apr 13 19:13:24 user nova-compute[71692]:   <devices>
Apr 13 19:13:24 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:13:24 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:13:24 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk"/>
Apr 13 19:13:24 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:13:24 user nova-compute[71692]:     </disk>
Apr 13 19:13:24 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:13:24 user nova-compute[71692]:       <mac address="fa:16:3e:a5:da:5a"/>
Apr 13 19:13:24 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:13:24 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:13:24 user nova-compute[71692]:       <target dev="tap06aa9cb5-cf"/>
Apr 13 19:13:24 user nova-compute[71692]:     </interface>
Apr 13 19:13:24 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:13:24 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/console.log" append="off"/>
Apr 13 19:13:24 user nova-compute[71692]:     </serial>
Apr 13 19:13:24 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:13:24 user nova-compute[71692]:     <video>
Apr 13 19:13:24 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:13:24 user nova-compute[71692]:     </video>
Apr 13 19:13:24 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:13:24 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:13:24 user nova-compute[71692]:     </rng>
Apr 13 19:13:24 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:13:24 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:13:24 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:13:24 user nova-compute[71692]:     </memballoon>
Apr 13 19:13:24 user nova-compute[71692]:   </devices>
Apr 13 19:13:24 user nova-compute[71692]: </domain>
Apr 13 19:13:24 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1162697425',display_name='tempest-VolumesActionsTest-instance-1162697425',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1162697425',id=30,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2877676ccbd0484d80ecabf3030c0ee4',ramdisk_id='',reservation_id='r-6koo2yvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-427747232',owner_user_name='tempest-VolumesActionsTest-427747232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:13:21Z,user_data=None,user_id='80063ed703d24a1b84aede724db205a7',uuid=e9428f3f-1910-421d-be9c-7ca42fa46334,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06aa9cb5-cf77-482a-8292-b82631f08459", "address": "fa:16:3e:a5:da:5a", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa9cb5-cf", "ovs_interfaceid": "06aa9cb5-cf77-482a-8292-b82631f08459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Converting VIF {"id": "06aa9cb5-cf77-482a-8292-b82631f08459", "address": "fa:16:3e:a5:da:5a", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa9cb5-cf", "ovs_interfaceid": "06aa9cb5-cf77-482a-8292-b82631f08459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:da:5a,bridge_name='br-int',has_traffic_filtering=True,id=06aa9cb5-cf77-482a-8292-b82631f08459,network=Network(b34bf81f-6825-4376-a26c-35386631a4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aa9cb5-cf') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG os_vif [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:da:5a,bridge_name='br-int',has_traffic_filtering=True,id=06aa9cb5-cf77-482a-8292-b82631f08459,network=Network(b34bf81f-6825-4376-a26c-35386631a4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aa9cb5-cf') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06aa9cb5-cf, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06aa9cb5-cf, col_values=(('external_ids', {'iface-id': '06aa9cb5-cf77-482a-8292-b82631f08459', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:da:5a', 'vm-uuid': 'e9428f3f-1910-421d-be9c-7ca42fa46334'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:24 user nova-compute[71692]: INFO os_vif [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:da:5a,bridge_name='br-int',has_traffic_filtering=True,id=06aa9cb5-cf77-482a-8292-b82631f08459,network=Network(b34bf81f-6825-4376-a26c-35386631a4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aa9cb5-cf')
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] No VIF found with MAC fa:16:3e:a5:da:5a, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ffc8830d176c3c93408bae1a1824785450ad5b4a.part /opt/stack/data/nova/instances/_base/ffc8830d176c3c93408bae1a1824785450ad5b4a.converted" returned: 0 in 0.457s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffc8830d176c3c93408bae1a1824785450ad5b4a.converted --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-66ff5f72-cb64-49e3-a8d9-84e9296e6791 req-49cda7b2-c700-4f67-a650-ddf02210588f service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-66ff5f72-cb64-49e3-a8d9-84e9296e6791 req-49cda7b2-c700-4f67-a650-ddf02210588f service nova] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-66ff5f72-cb64-49e3-a8d9-84e9296e6791 req-49cda7b2-c700-4f67-a650-ddf02210588f service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-66ff5f72-cb64-49e3-a8d9-84e9296e6791 req-49cda7b2-c700-4f67-a650-ddf02210588f service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-66ff5f72-cb64-49e3-a8d9-84e9296e6791 req-49cda7b2-c700-4f67-a650-ddf02210588f service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] No waiting events found dispatching network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:13:24 user nova-compute[71692]: WARNING nova.compute.manager [req-66ff5f72-cb64-49e3-a8d9-84e9296e6791 req-49cda7b2-c700-4f67-a650-ddf02210588f service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received unexpected event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 for instance with vm_state active and task_state rescuing.
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffc8830d176c3c93408bae1a1824785450ad5b4a.converted --force-share --output=json" returned: 0 in 0.155s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "ffc8830d176c3c93408bae1a1824785450ad5b4a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.587s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "ffc8830d176c3c93408bae1a1824785450ad5b4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "ffc8830d176c3c93408bae1a1824785450ad5b4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffc8830d176c3c93408bae1a1824785450ad5b4a --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.network.neutron [req-b4233070-f835-46d5-887b-7e0d090a9458 req-de3aea0c-7254-45fc-a277-c09f087c76f8 service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Updated VIF entry in instance network info cache for port 06aa9cb5-cf77-482a-8292-b82631f08459. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.network.neutron [req-b4233070-f835-46d5-887b-7e0d090a9458 req-de3aea0c-7254-45fc-a277-c09f087c76f8 service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Updating instance_info_cache with network_info: [{"id": "06aa9cb5-cf77-482a-8292-b82631f08459", "address": "fa:16:3e:a5:da:5a", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa9cb5-cf", "ovs_interfaceid": "06aa9cb5-cf77-482a-8292-b82631f08459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ffc8830d176c3c93408bae1a1824785450ad5b4a --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ffc8830d176c3c93408bae1a1824785450ad5b4a,backing_fmt=raw /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk.rescue {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b4233070-f835-46d5-887b-7e0d090a9458 req-de3aea0c-7254-45fc-a277-c09f087c76f8 service nova] Releasing lock "refresh_cache-e9428f3f-1910-421d-be9c-7ca42fa46334" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ffc8830d176c3c93408bae1a1824785450ad5b4a,backing_fmt=raw /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk.rescue" returned: 0 in 0.052s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "ffc8830d176c3c93408bae1a1824785450ad5b4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.objects.instance [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lazy-loading 'migration_context' on Instance uuid 33367b19-4d62-46dc-8346-45ea09c5563d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:13:24 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Start _get_guest_xml network_info=[{"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "vif_mac": "fa:16:3e:ac:21:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '36e14854-8ca1-420d-8642-21ad4d51b5d6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '41c828e7-221a-4de3-80ab-bacc96d8acc3', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAXCiaRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '33367b19-4d62-46dc-8346-45ea09c5563d', 'attached_at': '', 'detached_at': '', 'volume_id': 'ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185', 'serial': 'ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.objects.instance [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lazy-loading 'resources' on Instance uuid 33367b19-4d62-46dc-8346-45ea09c5563d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.objects.instance [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lazy-loading 'numa_topology' on Instance uuid 33367b19-4d62-46dc-8346-45ea09c5563d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:13:25 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:13:25 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.objects.instance [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lazy-loading 'vcpu_model' on Instance uuid 33367b19-4d62-46dc-8346-45ea09c5563d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAXCiaRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:13:25 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:13:25 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:13:25 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260" returned: 0 in 0.030s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[601715b8-0d90-4812-a116-0fb594f2be68]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NAXCiaRg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 19:13:25 user nova-compute[71692]: node.name = iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185
Apr 13 19:13:25 user nova-compute[71692]: node.tpgt = -1
Apr 13 19:13:25 user nova-compute[71692]: node.startup = automatic
Apr 13 19:13:25 user nova-compute[71692]: node.leading_login = No
Apr 13 19:13:25 user nova-compute[71692]: iface.iscsi_ifacename = default
Apr 13 19:13:25 user nova-compute[71692]: iface.net_ifacename = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.ipaddress = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.prefix_len = 0
Apr 13 19:13:25 user nova-compute[71692]: iface.hwaddress = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.transport_name = tcp
Apr 13 19:13:25 user nova-compute[71692]: iface.initiatorname = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.state = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.vlan_id = 0
Apr 13 19:13:25 user nova-compute[71692]: iface.vlan_priority = 0
Apr 13 19:13:25 user nova-compute[71692]: iface.vlan_state = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.iface_num = 0
Apr 13 19:13:25 user nova-compute[71692]: iface.mtu = 0
Apr 13 19:13:25 user nova-compute[71692]: iface.port = 0
Apr 13 19:13:25 user nova-compute[71692]: iface.bootproto = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.subnet_mask = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.gateway = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.dhcp_alt_client_id = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.dhcp_dns = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.dhcp_learn_iqn = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.dhcp_vendor_id_state = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.dhcp_vendor_id = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.dhcp_slp_da = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.fragmentation = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.gratuitous_arp = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.incoming_forwarding = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.tos_state = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.tos = 0
Apr 13 19:13:25 user nova-compute[71692]: iface.ttl = 0
Apr 13 19:13:25 user nova-compute[71692]: iface.delayed_ack = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.tcp_nagle = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.tcp_wsf_state = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.tcp_wsf = 0
Apr 13 19:13:25 user nova-compute[71692]: iface.tcp_timer_scale = 0
Apr 13 19:13:25 user nova-compute[71692]: iface.tcp_timestamp = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.redirect = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.def_task_mgmt_timeout = 0
Apr 13 19:13:25 user nova-compute[71692]: iface.header_digest = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.data_digest = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.immediate_data = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.initial_r2t = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.data_seq_inorder = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.data_pdu_inorder = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.erl = 0
Apr 13 19:13:25 user nova-compute[71692]: iface.max_receive_data_len = 0
Apr 13 19:13:25 user nova-compute[71692]: iface.first_burst_len = 0
Apr 13 19:13:25 user nova-compute[71692]: iface.max_outstanding_r2t = 0
Apr 13 19:13:25 user nova-compute[71692]: iface.max_burst_len = 0
Apr 13 19:13:25 user nova-compute[71692]: iface.chap_auth = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.bidi_chap = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.strict_login_compliance = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.discovery_auth = <empty>
Apr 13 19:13:25 user nova-compute[71692]: iface.discovery_logout = <empty>
Apr 13 19:13:25 user nova-compute[71692]: node.discovery_address = <empty>
Apr 13 19:13:25 user nova-compute[71692]: node.discovery_port = 0
Apr 13 19:13:25 user nova-compute[71692]: node.discovery_type = static
Apr 13 19:13:25 user nova-compute[71692]: node.session.initial_cmdsn = 0
Apr 13 19:13:25 user nova-compute[71692]: node.session.initial_login_retry_max = 8
Apr 13 19:13:25 user nova-compute[71692]: node.session.xmit_thread_priority = -20
Apr 13 19:13:25 user nova-compute[71692]: node.session.cmds_max = 128
Apr 13 19:13:25 user nova-compute[71692]: node.session.queue_depth = 32
Apr 13 19:13:25 user nova-compute[71692]: node.session.nr_sessions = 1
Apr 13 19:13:25 user nova-compute[71692]: node.session.auth.authmethod = CHAP
Apr 13 19:13:25 user nova-compute[71692]: node.session.auth.username = NAXCiaRg
Apr 13 19:13:25 user nova-compute[71692]: node.session.auth.password = ***
Apr 13 19:13:25 user nova-compute[71692]: node.session.auth.username_in = <empty>
Apr 13 19:13:25 user nova-compute[71692]: node.session.auth.password_in = <empty>
Apr 13 19:13:25 user nova-compute[71692]: node.session.auth.chap_algs = MD5
Apr 13 19:13:25 user nova-compute[71692]: node.session.timeo.replacement_timeout = 120
Apr 13 19:13:25 user nova-compute[71692]: node.session.err_timeo.abort_timeout = 15
Apr 13 19:13:25 user nova-compute[71692]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 19:13:25 user nova-compute[71692]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 19:13:25 user nova-compute[71692]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 19:13:25 user nova-compute[71692]: node.session.iscsi.FastAbort = Yes
Apr 13 19:13:25 user nova-compute[71692]: node.session.iscsi.InitialR2T = No
Apr 13 19:13:25 user nova-compute[71692]: node.session.iscsi.ImmediateData = Yes
Apr 13 19:13:25 user nova-compute[71692]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 19:13:25 user nova-compute[71692]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 19:13:25 user nova-compute[71692]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 19:13:25 user nova-compute[71692]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 19:13:25 user nova-compute[71692]: node.session.iscsi.MaxConnections = 1
Apr 13 19:13:25 user nova-compute[71692]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 19:13:25 user nova-compute[71692]: node.session.iscsi.ERL = 0
Apr 13 19:13:25 user nova-compute[71692]: node.session.scan = manual
Apr 13 19:13:25 user nova-compute[71692]: node.session.reopen_max = 0
Apr 13 19:13:25 user nova-compute[71692]: node.conn[0].address = 172.16.0.220
Apr 13 19:13:25 user nova-compute[71692]: node.conn[0].port = 3260
Apr 13 19:13:25 user nova-compute[71692]: node.conn[0].startup = manual
Apr 13 19:13:25 user nova-compute[71692]: node.conn[0].tcp.window_size = 524288
Apr 13 19:13:25 user nova-compute[71692]: node.conn[0].tcp.type_of_service = 0
Apr 13 19:13:25 user nova-compute[71692]: node.conn[0].timeo.logout_timeout = 15
Apr 13 19:13:25 user nova-compute[71692]: node.conn[0].timeo.login_timeout = 15
Apr 13 19:13:25 user nova-compute[71692]: node.conn[0].timeo.auth_timeout = 45
Apr 13 19:13:25 user nova-compute[71692]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 19:13:25 user nova-compute[71692]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 19:13:25 user nova-compute[71692]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 19:13:25 user nova-compute[71692]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 19:13:25 user nova-compute[71692]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 19:13:25 user nova-compute[71692]: node.conn[0].iscsi.DataDigest = None
Apr 13 19:13:25 user nova-compute[71692]: node.conn[0].iscsi.IFMarker = No
Apr 13 19:13:25 user nova-compute[71692]: node.conn[0].iscsi.OFMarker = No
Apr 13 19:13:25 user nova-compute[71692]: # END RECORD
Apr 13 19:13:25 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e8d7f3-1a38-4d54-b7a7-324d7d5f33e7]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[afad6d2e-6d2c-4d91-971d-20c830543ea6]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NAXCiaRg {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NAXCiaRg" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8f70e7-0629-480a-a827-6c6002045db5]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NAXCiaRg'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[171a9330-cccf-4bf7-8784-0c1b0e20ef5c]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a4ced8-493a-4db7-b4f6-dfc8e7482351]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:13:25 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:13:25 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:13:25 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:13:25 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:13:25 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:13:25 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.185s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] HCTL ('35', '0', '0', 0) found on session 31 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[30765c79-28d3-4f71-8f7f-7115902fd0dd]: (4, ('0 0 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Searching for a device in session 31 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAXCiaRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.211s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] <== connect_volume: return (213ms) {'type': 'block', 'scsi_wwn': '23631313665303438', 'path': '/dev/sdd'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631313665303438', 'path': '/dev/sdd'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-972621465',display_name='tempest-ServerStableDeviceRescueTest-server-972621465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-972621465',id=22,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/81JXVWb0rXwxJzcsxAa/8RybinXrc8Zl6qDPwrsL1kZEKNSUSm9I+Uhv2Knu1MvtLPpX14zkVbAGUt4k2gfpkYtA+Jt4hwEGaqZykAeWlkK9tm3g1d//gn87QHubXOQ==',key_name='tempest-keypair-822105464',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:09:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e1ef6e7b159468f90cfc0db2e8e904d',ramdisk_id='',reservation_id='r-p6e0pmxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-192327838',owner_user_name='tempest-ServerStableDeviceRescueTest-192327838-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:11:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a9282b733244da9bf210ddc66b74816',uuid=33367b19-4d62-46dc-8346-45ea09c5563d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "vif_mac": "fa:16:3e:ac:21:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Converting VIF {"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "vif_mac": "fa:16:3e:ac:21:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:21:e1,bridge_name='br-int',has_traffic_filtering=True,id=6d1659d8-90f3-45a5-90a0-772abe02c673,network=Network(12044ffa-ff1e-492a-b819-a301af851941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d1659d8-90') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.objects.instance [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lazy-loading 'pci_devices' on Instance uuid 33367b19-4d62-46dc-8346-45ea09c5563d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:13:25 user nova-compute[71692]:   <uuid>33367b19-4d62-46dc-8346-45ea09c5563d</uuid>
Apr 13 19:13:25 user nova-compute[71692]:   <name>instance-00000016</name>
Apr 13 19:13:25 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:13:25 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:13:25 user nova-compute[71692]:   <metadata>
Apr 13 19:13:25 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:13:25 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:13:25 user nova-compute[71692]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-972621465</nova:name>
Apr 13 19:13:25 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:13:25</nova:creationTime>
Apr 13 19:13:25 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:13:25 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:13:25 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:13:25 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:13:25 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:13:25 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:13:25 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:13:25 user nova-compute[71692]:       <nova:owner>
Apr 13 19:13:25 user nova-compute[71692]:         <nova:user uuid="4a9282b733244da9bf210ddc66b74816">tempest-ServerStableDeviceRescueTest-192327838-project-member</nova:user>
Apr 13 19:13:25 user nova-compute[71692]:         <nova:project uuid="7e1ef6e7b159468f90cfc0db2e8e904d">tempest-ServerStableDeviceRescueTest-192327838</nova:project>
Apr 13 19:13:25 user nova-compute[71692]:       </nova:owner>
Apr 13 19:13:25 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:13:25 user nova-compute[71692]:       <nova:ports>
Apr 13 19:13:25 user nova-compute[71692]:         <nova:port uuid="6d1659d8-90f3-45a5-90a0-772abe02c673">
Apr 13 19:13:25 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 19:13:25 user nova-compute[71692]:         </nova:port>
Apr 13 19:13:25 user nova-compute[71692]:       </nova:ports>
Apr 13 19:13:25 user nova-compute[71692]:     </nova:instance>
Apr 13 19:13:25 user nova-compute[71692]:   </metadata>
Apr 13 19:13:25 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:13:25 user nova-compute[71692]:     <system>
Apr 13 19:13:25 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:13:25 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:13:25 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:13:25 user nova-compute[71692]:       <entry name="serial">33367b19-4d62-46dc-8346-45ea09c5563d</entry>
Apr 13 19:13:25 user nova-compute[71692]:       <entry name="uuid">33367b19-4d62-46dc-8346-45ea09c5563d</entry>
Apr 13 19:13:25 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:13:25 user nova-compute[71692]:     </system>
Apr 13 19:13:25 user nova-compute[71692]:   </sysinfo>
Apr 13 19:13:25 user nova-compute[71692]:   <os>
Apr 13 19:13:25 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:13:25 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:13:25 user nova-compute[71692]:   </os>
Apr 13 19:13:25 user nova-compute[71692]:   <features>
Apr 13 19:13:25 user nova-compute[71692]:     <acpi/>
Apr 13 19:13:25 user nova-compute[71692]:     <apic/>
Apr 13 19:13:25 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:13:25 user nova-compute[71692]:   </features>
Apr 13 19:13:25 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:13:25 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:13:25 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:13:25 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:13:25 user nova-compute[71692]:   </clock>
Apr 13 19:13:25 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:13:25 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:13:25 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:13:25 user nova-compute[71692]:   </cpu>
Apr 13 19:13:25 user nova-compute[71692]:   <devices>
Apr 13 19:13:25 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:13:25 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:13:25 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk"/>
Apr 13 19:13:25 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:13:25 user nova-compute[71692]:     </disk>
Apr 13 19:13:25 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:13:25 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:13:25 user nova-compute[71692]:       <source dev="/dev/sdd"/>
Apr 13 19:13:25 user nova-compute[71692]:       <target dev="vdb" bus="virtio"/>
Apr 13 19:13:25 user nova-compute[71692]:       <serial>ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185</serial>
Apr 13 19:13:25 user nova-compute[71692]:     </disk>
Apr 13 19:13:25 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:13:25 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:13:25 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk.rescue"/>
Apr 13 19:13:25 user nova-compute[71692]:       <target dev="vdc" bus="virtio"/>
Apr 13 19:13:25 user nova-compute[71692]:       <boot order="1"/>
Apr 13 19:13:25 user nova-compute[71692]:     </disk>
Apr 13 19:13:25 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:13:25 user nova-compute[71692]:       <mac address="fa:16:3e:ac:21:e1"/>
Apr 13 19:13:25 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:13:25 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:13:25 user nova-compute[71692]:       <target dev="tap6d1659d8-90"/>
Apr 13 19:13:25 user nova-compute[71692]:     </interface>
Apr 13 19:13:25 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:13:25 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/console.log" append="off"/>
Apr 13 19:13:25 user nova-compute[71692]:     </serial>
Apr 13 19:13:25 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:13:25 user nova-compute[71692]:     <video>
Apr 13 19:13:25 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:13:25 user nova-compute[71692]:     </video>
Apr 13 19:13:25 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:13:25 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:13:25 user nova-compute[71692]:     </rng>
Apr 13 19:13:25 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:13:25 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:13:25 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:13:25 user nova-compute[71692]:     </memballoon>
Apr 13 19:13:25 user nova-compute[71692]:   </devices>
Apr 13 19:13:25 user nova-compute[71692]: </domain>
Apr 13 19:13:25 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:13:25 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Instance destroyed successfully.
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] No VIF found with MAC fa:16:3e:ac:21:e1, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG nova.compute.manager [req-364758d8-145b-420a-a3ea-7e6b2cd6b605 req-3ce60001-4ad5-46f6-9643-a6736fc3ed19 service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Received event network-vif-plugged-06aa9cb5-cf77-482a-8292-b82631f08459 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-364758d8-145b-420a-a3ea-7e6b2cd6b605 req-3ce60001-4ad5-46f6-9643-a6736fc3ed19 service nova] Acquiring lock "e9428f3f-1910-421d-be9c-7ca42fa46334-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-364758d8-145b-420a-a3ea-7e6b2cd6b605 req-3ce60001-4ad5-46f6-9643-a6736fc3ed19 service nova] Lock "e9428f3f-1910-421d-be9c-7ca42fa46334-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-364758d8-145b-420a-a3ea-7e6b2cd6b605 req-3ce60001-4ad5-46f6-9643-a6736fc3ed19 service nova] Lock "e9428f3f-1910-421d-be9c-7ca42fa46334-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:26 user nova-compute[71692]: DEBUG nova.compute.manager [req-364758d8-145b-420a-a3ea-7e6b2cd6b605 req-3ce60001-4ad5-46f6-9643-a6736fc3ed19 service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] No waiting events found dispatching network-vif-plugged-06aa9cb5-cf77-482a-8292-b82631f08459 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:13:26 user nova-compute[71692]: WARNING nova.compute.manager [req-364758d8-145b-420a-a3ea-7e6b2cd6b605 req-3ce60001-4ad5-46f6-9643-a6736fc3ed19 service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Received unexpected event network-vif-plugged-06aa9cb5-cf77-482a-8292-b82631f08459 for instance with vm_state building and task_state spawning.
Apr 13 19:13:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:27 user nova-compute[71692]: DEBUG nova.compute.manager [req-2d7fd032-36ba-4bcd-9d05-33a671d97419 req-f1de6ffe-152e-4d4d-913f-d0aa3ee172b9 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:13:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2d7fd032-36ba-4bcd-9d05-33a671d97419 req-f1de6ffe-152e-4d4d-913f-d0aa3ee172b9 service nova] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2d7fd032-36ba-4bcd-9d05-33a671d97419 req-f1de6ffe-152e-4d4d-913f-d0aa3ee172b9 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2d7fd032-36ba-4bcd-9d05-33a671d97419 req-f1de6ffe-152e-4d4d-913f-d0aa3ee172b9 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:27 user nova-compute[71692]: DEBUG nova.compute.manager [req-2d7fd032-36ba-4bcd-9d05-33a671d97419 req-f1de6ffe-152e-4d4d-913f-d0aa3ee172b9 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] No waiting events found dispatching network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:13:27 user nova-compute[71692]: WARNING nova.compute.manager [req-2d7fd032-36ba-4bcd-9d05-33a671d97419 req-f1de6ffe-152e-4d4d-913f-d0aa3ee172b9 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received unexpected event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 for instance with vm_state active and task_state rescuing.
Apr 13 19:13:28 user nova-compute[71692]: DEBUG nova.compute.manager [req-14e96bce-4059-4603-8b20-d74e6b3d896e req-7a5773d8-f25a-49da-8628-771571a82423 service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Received event network-vif-plugged-06aa9cb5-cf77-482a-8292-b82631f08459 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:13:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-14e96bce-4059-4603-8b20-d74e6b3d896e req-7a5773d8-f25a-49da-8628-771571a82423 service nova] Acquiring lock "e9428f3f-1910-421d-be9c-7ca42fa46334-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-14e96bce-4059-4603-8b20-d74e6b3d896e req-7a5773d8-f25a-49da-8628-771571a82423 service nova] Lock "e9428f3f-1910-421d-be9c-7ca42fa46334-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-14e96bce-4059-4603-8b20-d74e6b3d896e req-7a5773d8-f25a-49da-8628-771571a82423 service nova] Lock "e9428f3f-1910-421d-be9c-7ca42fa46334-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:28 user nova-compute[71692]: DEBUG nova.compute.manager [req-14e96bce-4059-4603-8b20-d74e6b3d896e req-7a5773d8-f25a-49da-8628-771571a82423 service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] No waiting events found dispatching network-vif-plugged-06aa9cb5-cf77-482a-8292-b82631f08459 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:13:28 user nova-compute[71692]: WARNING nova.compute.manager [req-14e96bce-4059-4603-8b20-d74e6b3d896e req-7a5773d8-f25a-49da-8628-771571a82423 service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Received unexpected event network-vif-plugged-06aa9cb5-cf77-482a-8292-b82631f08459 for instance with vm_state building and task_state spawning.
Apr 13 19:13:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413209.3172703, e9428f3f-1910-421d-be9c-7ca42fa46334 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:13:29 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] VM Resumed (Lifecycle Event)
Apr 13 19:13:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:13:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Instance spawned successfully.
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:13:29 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413209.3211193, e9428f3f-1910-421d-be9c-7ca42fa46334 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:13:29 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] VM Started (Lifecycle Event)
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:13:29 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:13:29 user nova-compute[71692]: INFO nova.compute.manager [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Took 8.22 seconds to spawn the instance on the hypervisor.
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:13:29 user nova-compute[71692]: INFO nova.compute.manager [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Took 9.00 seconds to build instance.
Apr 13 19:13:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e816b444-2f56-4919-95ae-241206bb41f2 tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "e9428f3f-1910-421d-be9c-7ca42fa46334" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.096s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Removed pending event for 33367b19-4d62-46dc-8346-45ea09c5563d due to event {{(pid=71692) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413209.7992444, 33367b19-4d62-46dc-8346-45ea09c5563d => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:13:29 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] VM Resumed (Lifecycle Event)
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f25192ed-da45-4ad0-ac58-d10a1a21778f tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:13:29 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413209.8002212, 33367b19-4d62-46dc-8346-45ea09c5563d => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:13:29 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] VM Started (Lifecycle Event)
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:13:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:13:30 user nova-compute[71692]: DEBUG nova.compute.manager [req-9d43f7b4-5d14-4726-a653-5285fbdb954d req-1fc717c5-7c7c-4731-8e1e-fa8c1b6e4475 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:13:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9d43f7b4-5d14-4726-a653-5285fbdb954d req-1fc717c5-7c7c-4731-8e1e-fa8c1b6e4475 service nova] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9d43f7b4-5d14-4726-a653-5285fbdb954d req-1fc717c5-7c7c-4731-8e1e-fa8c1b6e4475 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9d43f7b4-5d14-4726-a653-5285fbdb954d req-1fc717c5-7c7c-4731-8e1e-fa8c1b6e4475 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:30 user nova-compute[71692]: DEBUG nova.compute.manager [req-9d43f7b4-5d14-4726-a653-5285fbdb954d req-1fc717c5-7c7c-4731-8e1e-fa8c1b6e4475 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] No waiting events found dispatching network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:13:30 user nova-compute[71692]: WARNING nova.compute.manager [req-9d43f7b4-5d14-4726-a653-5285fbdb954d req-1fc717c5-7c7c-4731-8e1e-fa8c1b6e4475 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received unexpected event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 for instance with vm_state rescued and task_state None.
Apr 13 19:13:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid 29eeca99-f237-49d9-9c7d-5c5b7ff2892f {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid 59d7b86a-c723-4255-827e-2f6a641239df {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid 33367b19-4d62-46dc-8346-45ea09c5563d {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid 579c83e7-7976-47f4-9f25-a194e39966ba {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid 01bd39f7-7d27-48cf-982e-181aadc060ab {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid 1d7439c2-317e-4454-905f-dc8e59bc49e8 {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid a9f3d080-a163-4897-9187-2687cae49694 {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid e9428f3f-1910-421d-be9c-7ca42fa46334 {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "59d7b86a-c723-4255-827e-2f6a641239df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "59d7b86a-c723-4255-827e-2f6a641239df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "33367b19-4d62-46dc-8346-45ea09c5563d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "579c83e7-7976-47f4-9f25-a194e39966ba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "579c83e7-7976-47f4-9f25-a194e39966ba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "080204b2-fd4d-4224-b391-a27036d058ac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "1d7439c2-317e-4454-905f-dc8e59bc49e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "1d7439c2-317e-4454-905f-dc8e59bc49e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "a9f3d080-a163-4897-9187-2687cae49694" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "e9428f3f-1910-421d-be9c-7ca42fa46334" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "e9428f3f-1910-421d-be9c-7ca42fa46334" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "33367b19-4d62-46dc-8346-45ea09c5563d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "59d7b86a-c723-4255-827e-2f6a641239df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "579c83e7-7976-47f4-9f25-a194e39966ba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "a9f3d080-a163-4897-9187-2687cae49694" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "080204b2-fd4d-4224-b391-a27036d058ac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "1d7439c2-317e-4454-905f-dc8e59bc49e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "e9428f3f-1910-421d-be9c-7ca42fa46334" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:37 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:13:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:13:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:13:39 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:13:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:41 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:13:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:13:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:44 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:13:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:13:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-59d7b86a-c723-4255-827e-2f6a641239df" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:13:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-59d7b86a-c723-4255-827e-2f6a641239df" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:13:44 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:13:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:44 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Updating instance_info_cache with network_info: [{"id": "3de4b459-2a9f-4570-80b1-dce61f40a377", "address": "fa:16:3e:de:c1:80", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4b459-2a", "ovs_interfaceid": "3de4b459-2a9f-4570-80b1-dce61f40a377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:13:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-59d7b86a-c723-4255-827e-2f6a641239df" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:13:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:13:45 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:13:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:45 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:13:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:13:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:13:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:13:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:13:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:13:48 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:13:48 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:13:48 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=7566MB free_disk=25.97713851928711GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:13:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:13:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 59d7b86a-c723-4255-827e-2f6a641239df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 33367b19-4d62-46dc-8346-45ea09c5563d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 579c83e7-7976-47f4-9f25-a194e39966ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 01bd39f7-7d27-48cf-982e-181aadc060ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 080204b2-fd4d-4224-b391-a27036d058ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance a9f3d080-a163-4897-9187-2687cae49694 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance e9428f3f-1910-421d-be9c-7ca42fa46334 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:50 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:13:50 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:13:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:13:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:14:10 user nova-compute[71692]: DEBUG nova.compute.manager [req-32622b26-6915-4401-96e2-eeb5b9c91e0c req-b04c6e1e-e0dc-417e-b292-afde9ae4bfe8 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-changed-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:14:10 user nova-compute[71692]: DEBUG nova.compute.manager [req-32622b26-6915-4401-96e2-eeb5b9c91e0c req-b04c6e1e-e0dc-417e-b292-afde9ae4bfe8 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Refreshing instance network info cache due to event network-changed-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:14:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-32622b26-6915-4401-96e2-eeb5b9c91e0c req-b04c6e1e-e0dc-417e-b292-afde9ae4bfe8 service nova] Acquiring lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:14:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-32622b26-6915-4401-96e2-eeb5b9c91e0c req-b04c6e1e-e0dc-417e-b292-afde9ae4bfe8 service nova] Acquired lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:14:10 user nova-compute[71692]: DEBUG nova.network.neutron [req-32622b26-6915-4401-96e2-eeb5b9c91e0c req-b04c6e1e-e0dc-417e-b292-afde9ae4bfe8 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Refreshing network info cache for port 508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG nova.objects.instance [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'flavor' on Instance uuid 01bd39f7-7d27-48cf-982e-181aadc060ab {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:11 user nova-compute[71692]: INFO nova.compute.manager [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Attaching volume ecf4fd59-73f4-48eb-881a-97c8fbb14959 to /dev/vdb
Apr 13 19:14:11 user nova-compute[71692]: DEBUG os_brick.utils [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa08c21a-b2be-472f-a637-e1b517c26cc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[98543091-64c6-49cc-84f8-6606e6533134]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e435f8b7-34e0-4aef-967f-e13c351e4798]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc9c007-91d4-4db0-885b-0bee1089eeaf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:14:11 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8529ce-c9a4-468b-a2b0-30516ebb5116]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG os_brick.utils [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Updating existing volume attachment record: 951e365b-fcab-49b6-a54c-6f0564a57f98 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG nova.network.neutron [req-32622b26-6915-4401-96e2-eeb5b9c91e0c req-b04c6e1e-e0dc-417e-b292-afde9ae4bfe8 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Updated VIF entry in instance network info cache for port 508dc44c-24c7-4474-9d8a-8cd8a20fa1d6. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG nova.network.neutron [req-32622b26-6915-4401-96e2-eeb5b9c91e0c req-b04c6e1e-e0dc-417e-b292-afde9ae4bfe8 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Updating instance_info_cache with network_info: [{"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:14:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-32622b26-6915-4401-96e2-eeb5b9c91e0c req-b04c6e1e-e0dc-417e-b292-afde9ae4bfe8 service nova] Releasing lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:14:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HwnECePL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:14:15 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:14:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:14:15 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:14:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:14:15 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:14:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[91761017-965f-4cdd-9702-44d8dfc07a0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:14:15 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[20893c1a-ceb8-4884-bd48-9cc2349e6f9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959] added
Apr 13 19:14:15 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[667a426b-946d-4a6e-9905-4bf36ca06dc2]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7d5857-0ea8-415a-8bea-4b60fd01860c]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:15 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HwnECePL {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HwnECePL" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4497ad00-4e88-4bb0-baa4-7f9af54c4ba4]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HwnECePL'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d20a96-8a72-4d71-951f-69b1c72eb9cf]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a558f9-324c-404f-8b49-2a5cdc2dd37e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:14:16 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:14:16 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:14:16 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:14:16 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:14:16 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:14:16 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7944337a-ba7a-48e4-a09f-aa11421832cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959, portal: 172.16.0.220,3260]
Apr 13 19:14:16 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959, portal: 172.16.0.220,3260] successful.
Apr 13 19:14:16 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08b3131-d7a1-4813-8158-1612de920fdd]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bc61c0-7ee2-4d70-a3ce-a4b54cf3f8eb]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:14:16 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:14:16 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:14:16 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:14:16 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:14:16 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:14:16 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:14:16 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:14:16 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d79bfb-de48-48e7-bad0-92e395e3ff33]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HwnECePL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:14:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:14:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23263633061346562', 'path': '/dev/sde'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:14:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263633061346562', 'path': '/dev/sde'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:14:17 user nova-compute[71692]: DEBUG nova.objects.instance [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'flavor' on Instance uuid 01bd39f7-7d27-48cf-982e-181aadc060ab {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:14:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:14:17 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:14:17 user nova-compute[71692]:   <source dev="/dev/sde"/>
Apr 13 19:14:17 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:14:17 user nova-compute[71692]:   <serial>ecf4fd59-73f4-48eb-881a-97c8fbb14959</serial>
Apr 13 19:14:17 user nova-compute[71692]: </disk>
Apr 13 19:14:17 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:14:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:14:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:14:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No VIF found with MAC fa:16:3e:5a:81:9c, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:14:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-52b89773-ac0b-4995-9590-7a9b900b8c40 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.561s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:19 user nova-compute[71692]: INFO nova.compute.manager [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Rescuing
Apr 13 19:14:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:14:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquired lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:14:19 user nova-compute[71692]: DEBUG nova.network.neutron [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:14:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:19 user nova-compute[71692]: DEBUG nova.network.neutron [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Updating instance_info_cache with network_info: [{"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:14:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Releasing lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:14:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:19 user nova-compute[71692]: DEBUG nova.compute.manager [req-4956c2b3-ad4e-46bd-99a1-6268e886e788 req-990c464a-09dc-46b7-b087-a7570c831488 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-vif-unplugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:14:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4956c2b3-ad4e-46bd-99a1-6268e886e788 req-990c464a-09dc-46b7-b087-a7570c831488 service nova] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4956c2b3-ad4e-46bd-99a1-6268e886e788 req-990c464a-09dc-46b7-b087-a7570c831488 service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4956c2b3-ad4e-46bd-99a1-6268e886e788 req-990c464a-09dc-46b7-b087-a7570c831488 service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:19 user nova-compute[71692]: DEBUG nova.compute.manager [req-4956c2b3-ad4e-46bd-99a1-6268e886e788 req-990c464a-09dc-46b7-b087-a7570c831488 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] No waiting events found dispatching network-vif-unplugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:14:19 user nova-compute[71692]: WARNING nova.compute.manager [req-4956c2b3-ad4e-46bd-99a1-6268e886e788 req-990c464a-09dc-46b7-b087-a7570c831488 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received unexpected event network-vif-unplugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance with vm_state active and task_state rescuing.
Apr 13 19:14:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:20 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Instance destroyed successfully.
Apr 13 19:14:20 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Attempting rescue
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71692) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Instance directory exists: not creating {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 19:14:20 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Creating image(s)
Apr 13 19:14:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "/opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "/opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "/opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.objects.instance [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'trusted_certs' on Instance uuid 01bd39f7-7d27-48cf-982e-181aadc060ab {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.149s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk.rescue {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk.rescue" returned: 0 in 0.048s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.objects.instance [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'migration_context' on Instance uuid 01bd39f7-7d27-48cf-982e-181aadc060ab {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Start _get_guest_xml network_info=[{"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "vif_mac": "fa:16:3e:5a:81:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.objects.instance [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'resources' on Instance uuid 01bd39f7-7d27-48cf-982e-181aadc060ab {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.objects.instance [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'numa_topology' on Instance uuid 01bd39f7-7d27-48cf-982e-181aadc060ab {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:14:20 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:14:20 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.objects.instance [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'vcpu_model' on Instance uuid 01bd39f7-7d27-48cf-982e-181aadc060ab {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-243833659',display_name='tempest-ServerRescueNegativeTestJSON-server-243833659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-243833659',id=26,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETrtalpYQPcSKz1Uvc8zhcl0TlkdLfnCDAYE9b0Gxj6dj83NAjoPt6+VcHDiCV3eWgdAtbJV8ZhOtBKhYZ+l/OE7pG32jVdqRo02bInWOOtIHlsQQihOwUoItSmHcTOUw==',key_name='tempest-keypair-1767392597',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:12:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42fbd7089a7e4ba8b2597fca0d8e84c8',ramdisk_id='',reservation_id='r-vhean6yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1255770111',owner_user_name='tempest-ServerRescueNegativeTestJSON-1255770111-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:12:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bebf61a7401492692f9c60adde178f7',uuid=01bd39f7-7d27-48cf-982e-181aadc060ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "vif_mac": "fa:16:3e:5a:81:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converting VIF {"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "vif_mac": "fa:16:3e:5a:81:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:81:9c,bridge_name='br-int',has_traffic_filtering=True,id=508dc44c-24c7-4474-9d8a-8cd8a20fa1d6,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap508dc44c-24') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.objects.instance [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'pci_devices' on Instance uuid 01bd39f7-7d27-48cf-982e-181aadc060ab {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:14:20 user nova-compute[71692]:   <uuid>01bd39f7-7d27-48cf-982e-181aadc060ab</uuid>
Apr 13 19:14:20 user nova-compute[71692]:   <name>instance-0000001a</name>
Apr 13 19:14:20 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:14:20 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:14:20 user nova-compute[71692]:   <metadata>
Apr 13 19:14:20 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:14:20 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:14:20 user nova-compute[71692]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-243833659</nova:name>
Apr 13 19:14:20 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:14:20</nova:creationTime>
Apr 13 19:14:20 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:14:20 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:14:20 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:14:20 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:14:20 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:14:20 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:14:20 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:14:20 user nova-compute[71692]:       <nova:owner>
Apr 13 19:14:20 user nova-compute[71692]:         <nova:user uuid="3bebf61a7401492692f9c60adde178f7">tempest-ServerRescueNegativeTestJSON-1255770111-project-member</nova:user>
Apr 13 19:14:20 user nova-compute[71692]:         <nova:project uuid="42fbd7089a7e4ba8b2597fca0d8e84c8">tempest-ServerRescueNegativeTestJSON-1255770111</nova:project>
Apr 13 19:14:20 user nova-compute[71692]:       </nova:owner>
Apr 13 19:14:20 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:14:20 user nova-compute[71692]:       <nova:ports>
Apr 13 19:14:20 user nova-compute[71692]:         <nova:port uuid="508dc44c-24c7-4474-9d8a-8cd8a20fa1d6">
Apr 13 19:14:20 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 19:14:20 user nova-compute[71692]:         </nova:port>
Apr 13 19:14:20 user nova-compute[71692]:       </nova:ports>
Apr 13 19:14:20 user nova-compute[71692]:     </nova:instance>
Apr 13 19:14:20 user nova-compute[71692]:   </metadata>
Apr 13 19:14:20 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:14:20 user nova-compute[71692]:     <system>
Apr 13 19:14:20 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:14:20 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:14:20 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:14:20 user nova-compute[71692]:       <entry name="serial">01bd39f7-7d27-48cf-982e-181aadc060ab</entry>
Apr 13 19:14:20 user nova-compute[71692]:       <entry name="uuid">01bd39f7-7d27-48cf-982e-181aadc060ab</entry>
Apr 13 19:14:20 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:14:20 user nova-compute[71692]:     </system>
Apr 13 19:14:20 user nova-compute[71692]:   </sysinfo>
Apr 13 19:14:20 user nova-compute[71692]:   <os>
Apr 13 19:14:20 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:14:20 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:14:20 user nova-compute[71692]:   </os>
Apr 13 19:14:20 user nova-compute[71692]:   <features>
Apr 13 19:14:20 user nova-compute[71692]:     <acpi/>
Apr 13 19:14:20 user nova-compute[71692]:     <apic/>
Apr 13 19:14:20 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:14:20 user nova-compute[71692]:   </features>
Apr 13 19:14:20 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:14:20 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:14:20 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:14:20 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:14:20 user nova-compute[71692]:   </clock>
Apr 13 19:14:20 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:14:20 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:14:20 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:14:20 user nova-compute[71692]:   </cpu>
Apr 13 19:14:20 user nova-compute[71692]:   <devices>
Apr 13 19:14:20 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:14:20 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:14:20 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk.rescue"/>
Apr 13 19:14:20 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:14:20 user nova-compute[71692]:     </disk>
Apr 13 19:14:20 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:14:20 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:14:20 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk"/>
Apr 13 19:14:20 user nova-compute[71692]:       <target dev="vdb" bus="virtio"/>
Apr 13 19:14:20 user nova-compute[71692]:     </disk>
Apr 13 19:14:20 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:14:20 user nova-compute[71692]:       <mac address="fa:16:3e:5a:81:9c"/>
Apr 13 19:14:20 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:14:20 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:14:20 user nova-compute[71692]:       <target dev="tap508dc44c-24"/>
Apr 13 19:14:20 user nova-compute[71692]:     </interface>
Apr 13 19:14:20 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:14:20 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/console.log" append="off"/>
Apr 13 19:14:20 user nova-compute[71692]:     </serial>
Apr 13 19:14:20 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:14:20 user nova-compute[71692]:     <video>
Apr 13 19:14:20 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:14:20 user nova-compute[71692]:     </video>
Apr 13 19:14:20 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:14:20 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:14:20 user nova-compute[71692]:     </rng>
Apr 13 19:14:20 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:14:20 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:14:20 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:14:20 user nova-compute[71692]:     </memballoon>
Apr 13 19:14:20 user nova-compute[71692]:   </devices>
Apr 13 19:14:20 user nova-compute[71692]: </domain>
Apr 13 19:14:20 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:14:20 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Instance destroyed successfully.
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:14:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] No VIF found with MAC fa:16:3e:5a:81:9c, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:14:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:21 user nova-compute[71692]: DEBUG nova.compute.manager [req-df92b2e0-e89a-4d9d-9263-344bce1c69c7 req-a08c018c-327d-41b5-bd76-3e01693c6acd service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:14:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-df92b2e0-e89a-4d9d-9263-344bce1c69c7 req-a08c018c-327d-41b5-bd76-3e01693c6acd service nova] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-df92b2e0-e89a-4d9d-9263-344bce1c69c7 req-a08c018c-327d-41b5-bd76-3e01693c6acd service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-df92b2e0-e89a-4d9d-9263-344bce1c69c7 req-a08c018c-327d-41b5-bd76-3e01693c6acd service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:21 user nova-compute[71692]: DEBUG nova.compute.manager [req-df92b2e0-e89a-4d9d-9263-344bce1c69c7 req-a08c018c-327d-41b5-bd76-3e01693c6acd service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] No waiting events found dispatching network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:14:21 user nova-compute[71692]: WARNING nova.compute.manager [req-df92b2e0-e89a-4d9d-9263-344bce1c69c7 req-a08c018c-327d-41b5-bd76-3e01693c6acd service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received unexpected event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance with vm_state active and task_state rescuing.
Apr 13 19:14:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:23 user nova-compute[71692]: DEBUG nova.compute.manager [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:14:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:23 user nova-compute[71692]: DEBUG nova.compute.manager [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] No waiting events found dispatching network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:14:23 user nova-compute[71692]: WARNING nova.compute.manager [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received unexpected event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance with vm_state active and task_state rescuing.
Apr 13 19:14:23 user nova-compute[71692]: DEBUG nova.compute.manager [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:14:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:23 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:23 user nova-compute[71692]: DEBUG nova.compute.manager [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] No waiting events found dispatching network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:14:23 user nova-compute[71692]: WARNING nova.compute.manager [req-d8d1a4b7-970b-4bc0-a31e-a1a30d6e59c4 req-309599d4-268c-4edc-9f76-270d5642249a service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received unexpected event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance with vm_state active and task_state rescuing.
Apr 13 19:14:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:24 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Removed pending event for 01bd39f7-7d27-48cf-982e-181aadc060ab due to event {{(pid=71692) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 19:14:24 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413264.4468052, 01bd39f7-7d27-48cf-982e-181aadc060ab => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:14:24 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] VM Resumed (Lifecycle Event)
Apr 13 19:14:24 user nova-compute[71692]: DEBUG nova.compute.manager [None req-71d2e37b-97e2-4f21-8b70-316cd71436e2 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:14:24 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:14:24 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:14:24 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 19:14:24 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413264.4487727, 01bd39f7-7d27-48cf-982e-181aadc060ab => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:14:24 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] VM Started (Lifecycle Event)
Apr 13 19:14:24 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:14:24 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:14:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:14:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:14:39 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:14:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:40 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:14:40 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:14:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:43 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:14:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:14:44 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:14:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:14:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:14:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:14:44 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:14:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:44 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Updating instance_info_cache with network_info: [{"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:14:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:14:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG nova.compute.manager [req-df45bea0-35c8-45da-b378-73c848d72daf req-3dfd8b30-c42c-4a21-a38c-3dedf48f5f85 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Received event network-changed-a29956b4-c9c2-4c86-bf4a-488fb5f45af0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG nova.compute.manager [req-df45bea0-35c8-45da-b378-73c848d72daf req-3dfd8b30-c42c-4a21-a38c-3dedf48f5f85 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Refreshing instance network info cache due to event network-changed-a29956b4-c9c2-4c86-bf4a-488fb5f45af0. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-df45bea0-35c8-45da-b378-73c848d72daf req-3dfd8b30-c42c-4a21-a38c-3dedf48f5f85 service nova] Acquiring lock "refresh_cache-080204b2-fd4d-4224-b391-a27036d058ac" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-df45bea0-35c8-45da-b378-73c848d72daf req-3dfd8b30-c42c-4a21-a38c-3dedf48f5f85 service nova] Acquired lock "refresh_cache-080204b2-fd4d-4224-b391-a27036d058ac" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG nova.network.neutron [req-df45bea0-35c8-45da-b378-73c848d72daf req-3dfd8b30-c42c-4a21-a38c-3dedf48f5f85 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Refreshing network info cache for port a29956b4-c9c2-4c86-bf4a-488fb5f45af0 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:46 user nova-compute[71692]: DEBUG nova.objects.instance [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'flavor' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:47 user nova-compute[71692]: INFO nova.compute.manager [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Attaching volume 54fb8bde-5953-4aa4-ad80-0e14e1690582 to /dev/vdb
Apr 13 19:14:47 user nova-compute[71692]: DEBUG os_brick.utils [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f54ec0-0180-4bfa-925f-45e5d0843da9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG nova.network.neutron [req-df45bea0-35c8-45da-b378-73c848d72daf req-3dfd8b30-c42c-4a21-a38c-3dedf48f5f85 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Updated VIF entry in instance network info cache for port a29956b4-c9c2-4c86-bf4a-488fb5f45af0. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG nova.network.neutron [req-df45bea0-35c8-45da-b378-73c848d72daf req-3dfd8b30-c42c-4a21-a38c-3dedf48f5f85 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Updating instance_info_cache with network_info: [{"id": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "address": "fa:16:3e:8e:c2:1f", "network": {"id": "f73b1428-f00d-4eeb-91eb-d5c99ee34946", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-533041060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b7cc9c0ba145bea0585e887a92c788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa29956b4-c9", "ovs_interfaceid": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3325c952-ce10-4493-bed7-5023fda17984]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-df45bea0-35c8-45da-b378-73c848d72daf req-3dfd8b30-c42c-4a21-a38c-3dedf48f5f85 service nova] Releasing lock "refresh_cache-080204b2-fd4d-4224-b391-a27036d058ac" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bd4b62-4793-4cc3-a4fb-a4afc7b96850]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[463eec45-ba38-479f-aa8a-21bb9e3127f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:14:47 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8486b529-0207-4398-a6bb-5921212fb3f8]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG os_brick.utils [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Updating existing volume attachment record: 85dc8fba-f90c-4cf7-a7f4-a2019c920a7b {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:14:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:14:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:49 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:14:49 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:14:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=7808MB free_disk=25.946937561035156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:14:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:14:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 59d7b86a-c723-4255-827e-2f6a641239df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:14:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 33367b19-4d62-46dc-8346-45ea09c5563d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:14:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:14:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 579c83e7-7976-47f4-9f25-a194e39966ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:14:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 01bd39f7-7d27-48cf-982e-181aadc060ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:14:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 080204b2-fd4d-4224-b391-a27036d058ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:14:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 1d7439c2-317e-4454-905f-dc8e59bc49e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:14:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance a9f3d080-a163-4897-9187-2687cae49694 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:14:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance e9428f3f-1910-421d-be9c-7ca42fa46334 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:14:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:14:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:14:50 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:14:50 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:14:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:14:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqjLSBCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:14:51 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:14:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:14:51 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:14:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:14:51 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d1f99f-67a1-4381-b66b-9b3a39ce947e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:14:51 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbea8976-a817-4689-a643-f82f0621b173]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582] added
Apr 13 19:14:51 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd3c66d-7c81-4bea-b0d1-7f10d9ecee8a]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc461d71-7707-421c-9847-6dae10907ac2]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lqjLSBCI {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lqjLSBCI" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7549853-2b9e-4495-993d-f7009a2dfd79]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lqjLSBCI'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b795333-078c-40ca-9023-243a18127559]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3918ce-7d0f-4ec7-b621-e991988dfb9e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:14:51 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:14:51 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:14:51 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:14:51 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:14:51 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:14:51 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:14:51 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:14:51 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:14:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca9eb8f-0b74-40d4-aa68-46d3e8de0ddd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582, portal: 172.16.0.220,3260]
Apr 13 19:14:52 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582, portal: 172.16.0.220,3260] successful.
Apr 13 19:14:52 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[277f92f9-aaa7-4fd9-a556-5f8810702328]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb19b843-fd0e-4142-b75d-88decf446285]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:14:52 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:14:52 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:14:52 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:14:52 user nova-compute[71692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 (non-flash)
Apr 13 19:14:52 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:14:52 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:14:52 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:14:52 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:14:52 user nova-compute[71692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 (non-flash)
Apr 13 19:14:52 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ae5165-060b-4b9d-9b40-288df2df7fbb]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG nova.compute.manager [req-ca2d83d0-eaaa-466a-9523-915e02700f91 req-1931da0e-c999-438c-8a9e-12b1aa9bb699 service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Received event network-changed-2df65aa5-af8b-4d51-8246-ed31a3e0219e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG nova.compute.manager [req-ca2d83d0-eaaa-466a-9523-915e02700f91 req-1931da0e-c999-438c-8a9e-12b1aa9bb699 service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Refreshing instance network info cache due to event network-changed-2df65aa5-af8b-4d51-8246-ed31a3e0219e. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ca2d83d0-eaaa-466a-9523-915e02700f91 req-1931da0e-c999-438c-8a9e-12b1aa9bb699 service nova] Acquiring lock "refresh_cache-1d7439c2-317e-4454-905f-dc8e59bc49e8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ca2d83d0-eaaa-466a-9523-915e02700f91 req-1931da0e-c999-438c-8a9e-12b1aa9bb699 service nova] Acquired lock "refresh_cache-1d7439c2-317e-4454-905f-dc8e59bc49e8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG nova.network.neutron [req-ca2d83d0-eaaa-466a-9523-915e02700f91 req-1931da0e-c999-438c-8a9e-12b1aa9bb699 service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Refreshing network info cache for port 2df65aa5-af8b-4d51-8246-ed31a3e0219e {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1d7439c2-317e-4454-905f-dc8e59bc49e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1d7439c2-317e-4454-905f-dc8e59bc49e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "1d7439c2-317e-4454-905f-dc8e59bc49e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1d7439c2-317e-4454-905f-dc8e59bc49e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1d7439c2-317e-4454-905f-dc8e59bc49e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:52 user nova-compute[71692]: INFO nova.compute.manager [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Terminating instance
Apr 13 19:14:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqjLSBCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23333636435323164', 'path': '/dev/sdf'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333636435323164', 'path': '/dev/sdf'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG nova.objects.instance [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'flavor' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:14:53 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:14:53 user nova-compute[71692]:   <source dev="/dev/sdf"/>
Apr 13 19:14:53 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:14:53 user nova-compute[71692]:   <serial>54fb8bde-5953-4aa4-ad80-0e14e1690582</serial>
Apr 13 19:14:53 user nova-compute[71692]: </disk>
Apr 13 19:14:53 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG nova.network.neutron [req-ca2d83d0-eaaa-466a-9523-915e02700f91 req-1931da0e-c999-438c-8a9e-12b1aa9bb699 service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Updated VIF entry in instance network info cache for port 2df65aa5-af8b-4d51-8246-ed31a3e0219e. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG nova.network.neutron [req-ca2d83d0-eaaa-466a-9523-915e02700f91 req-1931da0e-c999-438c-8a9e-12b1aa9bb699 service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Updating instance_info_cache with network_info: [{"id": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "address": "fa:16:3e:62:30:18", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df65aa5-af", "ovs_interfaceid": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ca2d83d0-eaaa-466a-9523-915e02700f91 req-1931da0e-c999-438c-8a9e-12b1aa9bb699 service nova] Releasing lock "refresh_cache-1d7439c2-317e-4454-905f-dc8e59bc49e8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] No VIF found with MAC fa:16:3e:8e:c2:1f, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-08c39680-1f3f-4b44-b969-a41ec2cac00e tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.439s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:53 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Instance destroyed successfully.
Apr 13 19:14:53 user nova-compute[71692]: DEBUG nova.objects.instance [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'resources' on Instance uuid 1d7439c2-317e-4454-905f-dc8e59bc49e8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:13:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1026578346',display_name='tempest-AttachVolumeNegativeTest-server-1026578346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1026578346',id=28,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvx+NdVaRzGRxiQY+XYoIW6YuPWvMsgN7CXZ0pBdpM8XxJvUcI0Aw9ztA/htv8tlmF0ErI6crkAH0Uw9JA9IEn3VjvSl6uTMrNFJqI5sjQP4v1MscAIBS4R6Qf+HcOgZQ==',key_name='tempest-keypair-701851917',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:13:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dcc458426af4ea2b4bbcfdf9b4fe041',ramdisk_id='',reservation_id='r-qr8d0680',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-513091417',owner_user_name='tempest-AttachVolumeNegativeTest-513091417-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:13:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975d5fe9f1e445f0ba1be8fc71e93ecc',uuid=1d7439c2-317e-4454-905f-dc8e59bc49e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "address": "fa:16:3e:62:30:18", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df65aa5-af", "ovs_interfaceid": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converting VIF {"id": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "address": "fa:16:3e:62:30:18", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2df65aa5-af", "ovs_interfaceid": "2df65aa5-af8b-4d51-8246-ed31a3e0219e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:30:18,bridge_name='br-int',has_traffic_filtering=True,id=2df65aa5-af8b-4d51-8246-ed31a3e0219e,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df65aa5-af') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG os_vif [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:30:18,bridge_name='br-int',has_traffic_filtering=True,id=2df65aa5-af8b-4d51-8246-ed31a3e0219e,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df65aa5-af') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2df65aa5-af, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:53 user nova-compute[71692]: INFO os_vif [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:30:18,bridge_name='br-int',has_traffic_filtering=True,id=2df65aa5-af8b-4d51-8246-ed31a3e0219e,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2df65aa5-af')
Apr 13 19:14:53 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Deleting instance files /opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8_del
Apr 13 19:14:53 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Deletion of /opt/stack/data/nova/instances/1d7439c2-317e-4454-905f-dc8e59bc49e8_del complete
Apr 13 19:14:53 user nova-compute[71692]: INFO nova.compute.manager [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 13 19:14:53 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:14:53 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:14:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Received event network-vif-unplugged-2df65aa5-af8b-4d51-8246-ed31a3e0219e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:14:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] Acquiring lock "1d7439c2-317e-4454-905f-dc8e59bc49e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] Lock "1d7439c2-317e-4454-905f-dc8e59bc49e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] Lock "1d7439c2-317e-4454-905f-dc8e59bc49e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] No waiting events found dispatching network-vif-unplugged-2df65aa5-af8b-4d51-8246-ed31a3e0219e {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:14:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Received event network-vif-unplugged-2df65aa5-af8b-4d51-8246-ed31a3e0219e for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:14:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Received event network-vif-plugged-2df65aa5-af8b-4d51-8246-ed31a3e0219e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:14:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] Acquiring lock "1d7439c2-317e-4454-905f-dc8e59bc49e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] Lock "1d7439c2-317e-4454-905f-dc8e59bc49e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] Lock "1d7439c2-317e-4454-905f-dc8e59bc49e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] No waiting events found dispatching network-vif-plugged-2df65aa5-af8b-4d51-8246-ed31a3e0219e {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:14:54 user nova-compute[71692]: WARNING nova.compute.manager [req-5291ce9d-4e23-45e7-87e1-79d19026e980 req-6f0fd79e-797f-4047-9a6b-bba265c4e00d service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Received unexpected event network-vif-plugged-2df65aa5-af8b-4d51-8246-ed31a3e0219e for instance with vm_state active and task_state deleting.
Apr 13 19:14:54 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:14:54 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Took 1.08 seconds to deallocate network for instance.
Apr 13 19:14:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:55 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:14:55 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:14:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:55 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Deleted allocations for instance 1d7439c2-317e-4454-905f-dc8e59bc49e8
Apr 13 19:14:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7a7e2483-847b-400e-a1d3-5cc4c16dd61b tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "1d7439c2-317e-4454-905f-dc8e59bc49e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.511s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Received event network-vif-deleted-2df65aa5-af8b-4d51-8246-ed31a3e0219e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:14:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Received event network-changed-ab959649-556a-479c-9e13-ec36fb9ebb66 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:14:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Refreshing instance network info cache due to event network-changed-ab959649-556a-479c-9e13-ec36fb9ebb66. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:14:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] Acquiring lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:14:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] Acquired lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:14:56 user nova-compute[71692]: DEBUG nova.network.neutron [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Refreshing network info cache for port ab959649-556a-479c-9e13-ec36fb9ebb66 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG nova.network.neutron [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Updated VIF entry in instance network info cache for port ab959649-556a-479c-9e13-ec36fb9ebb66. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG nova.network.neutron [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Updating instance_info_cache with network_info: [{"id": "ab959649-556a-479c-9e13-ec36fb9ebb66", "address": "fa:16:3e:4b:6d:5f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab959649-55", "ovs_interfaceid": "ab959649-556a-479c-9e13-ec36fb9ebb66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] Releasing lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG nova.compute.manager [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received event network-changed-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG nova.compute.manager [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Refreshing instance network info cache due to event network-changed-2207b77c-fc08-471c-8281-cd1f6061ea54. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] Acquiring lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] Acquired lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG nova.network.neutron [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Refreshing network info cache for port 2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Stashing vm_state: active {{(pid=71692) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG nova.objects.instance [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'pci_requests' on Instance uuid a9f3d080-a163-4897-9187-2687cae49694 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:14:57 user nova-compute[71692]: INFO nova.compute.claims [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Claim successful on node user
Apr 13 19:14:57 user nova-compute[71692]: DEBUG nova.objects.instance [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'resources' on Instance uuid a9f3d080-a163-4897-9187-2687cae49694 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG nova.objects.instance [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'pci_devices' on Instance uuid a9f3d080-a163-4897-9187-2687cae49694 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:14:57 user nova-compute[71692]: INFO nova.compute.resource_tracker [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Updating resource usage from migration 9a0976be-7ccb-41ea-a57f-8d3dcd983361
Apr 13 19:14:57 user nova-compute[71692]: DEBUG nova.network.neutron [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Updated VIF entry in instance network info cache for port 2207b77c-fc08-471c-8281-cd1f6061ea54. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG nova.network.neutron [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Updating instance_info_cache with network_info: [{"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ac577302-5de8-4cee-969d-58c0866275f0 req-5d1cdada-20ec-43c0-b377-2bc8448efb77 service nova] Releasing lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:14:57 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:14:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.420s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:58 user nova-compute[71692]: INFO nova.compute.manager [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Migrating
Apr 13 19:14:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:14:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquired lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:14:58 user nova-compute[71692]: DEBUG nova.network.neutron [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:14:58 user nova-compute[71692]: DEBUG nova.network.neutron [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Updating instance_info_cache with network_info: [{"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:14:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Releasing lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:14:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Starting migrate_disk_and_power_off {{(pid=71692) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 13 19:14:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-9b50ff01-06e8-40b5-a06e-8e397e40a039 req-4d7dcba7-613b-4dc1-87a4-184fe9531a23 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received event network-vif-unplugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9b50ff01-06e8-40b5-a06e-8e397e40a039 req-4d7dcba7-613b-4dc1-87a4-184fe9531a23 service nova] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9b50ff01-06e8-40b5-a06e-8e397e40a039 req-4d7dcba7-613b-4dc1-87a4-184fe9531a23 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9b50ff01-06e8-40b5-a06e-8e397e40a039 req-4d7dcba7-613b-4dc1-87a4-184fe9531a23 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-9b50ff01-06e8-40b5-a06e-8e397e40a039 req-4d7dcba7-613b-4dc1-87a4-184fe9531a23 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] No waiting events found dispatching network-vif-unplugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:14:59 user nova-compute[71692]: WARNING nova.compute.manager [req-9b50ff01-06e8-40b5-a06e-8e397e40a039 req-4d7dcba7-613b-4dc1-87a4-184fe9531a23 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received unexpected event network-vif-unplugged-2207b77c-fc08-471c-8281-cd1f6061ea54 for instance with vm_state active and task_state resize_migrating.
Apr 13 19:14:59 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: a9f3d080-a163-4897-9187-2687cae49694] Instance destroyed successfully.
Apr 13 19:14:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1898726378',display_name='tempest-ServerActionsTestJSON-server-1898726378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1898726378',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:13:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-z4fn11mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:14:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=a9f3d080-a163-4897-9187-2687cae49694,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-383984590-network", "vif_mac": "fa:16:3e:7b:c7:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-383984590-network", "vif_mac": "fa:16:3e:7b:c7:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=2207b77c-fc08-471c-8281-cd1f6061ea54,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2207b77c-fc') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_vif [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=2207b77c-fc08-471c-8281-cd1f6061ea54,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2207b77c-fc') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2207b77c-fc, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:14:59 user nova-compute[71692]: INFO os_vif [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=2207b77c-fc08-471c-8281-cd1f6061ea54,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2207b77c-fc')
Apr 13 19:14:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTPAhqcO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:14:59 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ace61b5-7b6d-4b86-9109-7ff0c880581c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:14:59 user nova-compute[71692]: No targets found.
Apr 13 19:14:59 user nova-compute[71692]: iSNS:
Apr 13 19:14:59 user nova-compute[71692]: No targets found.
Apr 13 19:14:59 user nova-compute[71692]: STATIC:
Apr 13 19:14:59 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7
Apr 13 19:14:59 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:14:59 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:14:59 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959
Apr 13 19:14:59 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:14:59 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:14:59 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185
Apr 13 19:14:59 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:14:59 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:14:59 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582
Apr 13 19:14:59 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:14:59 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:14:59 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2
Apr 13 19:14:59 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:14:59 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:14:59 user nova-compute[71692]: FIRMWARE:
Apr 13 19:14:59 user nova-compute[71692]: No targets found.
Apr 13 19:14:59 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:14:59 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:14:59 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c6479e-7d3e-4bc7-8688-3ae2cb169df5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e6c06f-d39b-4122-9762-5a8495af638a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:14:59 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:14:59 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:14:59 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:14:59 user nova-compute[71692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 (non-flash)
Apr 13 19:14:59 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:14:59 user nova-compute[71692]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:14:59 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:14:59 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:14:59 user nova-compute[71692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 (non-flash)
Apr 13 19:14:59 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc6d65f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2'): ({'sdb'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Removing single pathed devices sdb {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c2190c-4de7-4b0f-ad9c-940eed1b860e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c91ee2-ef56-45a4-a637-96b0e2d6fd18]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flushing IO for device /dev/sdb {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b8f68b-d471-4257-a8a4-02af7253265e]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c417b53-1077-47e0-8498-5a34b2e66dac]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc3d08a1-95745c42d436d2ed', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c3d08a1', '/dev/disk/by-id/scsi-23935373435633432') {{(pid=82243) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[768a954f-c625-4858-b033-e7d5e68e4bfd]: (4, None) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6bf12c-f13f-49dd-aa69-36ecc6a96a25]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b418af4f-2f34-4ce2-99c4-6ba640eb5035]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2, portal: 172.16.0.220,3260]
Apr 13 19:14:59 user nova-compute[71692]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2, portal: 172.16.0.220,3260] successful.
Apr 13 19:14:59 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c51d9f-c67d-433f-ad70-ab95c79ef0df]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== disconnect_volume: return (311ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:14:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:15:00 user nova-compute[71692]: DEBUG nova.network.neutron [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Port 2207b77c-fc08-471c-8281-cd1f6061ea54 binding to destination host user is already ACTIVE {{(pid=71692) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 19:15:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:15:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquired lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:15:00 user nova-compute[71692]: DEBUG nova.network.neutron [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-1f930ddc-116f-4700-8938-6e57c261f7b7 req-0c5f92ff-f57f-4775-b8ff-17304be9e92f service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1f930ddc-116f-4700-8938-6e57c261f7b7 req-0c5f92ff-f57f-4775-b8ff-17304be9e92f service nova] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1f930ddc-116f-4700-8938-6e57c261f7b7 req-0c5f92ff-f57f-4775-b8ff-17304be9e92f service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1f930ddc-116f-4700-8938-6e57c261f7b7 req-0c5f92ff-f57f-4775-b8ff-17304be9e92f service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-1f930ddc-116f-4700-8938-6e57c261f7b7 req-0c5f92ff-f57f-4775-b8ff-17304be9e92f service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] No waiting events found dispatching network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:15:01 user nova-compute[71692]: WARNING nova.compute.manager [req-1f930ddc-116f-4700-8938-6e57c261f7b7 req-0c5f92ff-f57f-4775-b8ff-17304be9e92f service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received unexpected event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 for instance with vm_state active and task_state resize_migrated.
Apr 13 19:15:01 user nova-compute[71692]: DEBUG nova.network.neutron [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Updating instance_info_cache with network_info: [{"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Releasing lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG os_brick.utils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ca58c3-0357-4c00-bc78-db8ffdd7b741]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0072b077-dc26-4037-86f9-2d13ee99bafa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26dc04f-0027-473e-88ef-9729276cd170]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c212d6c-7b4b-41d3-b47f-7c8d8ea0ad09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:15:01 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:15:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa69e29-8e91-41fa-a8b4-0ed2238e6ff7]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:15:01 user nova-compute[71692]: DEBUG os_brick.utils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:03 user nova-compute[71692]: INFO nova.compute.manager [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Detaching volume 54fb8bde-5953-4aa4-ad80-0e14e1690582
Apr 13 19:15:03 user nova-compute[71692]: INFO nova.virt.block_device [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Attempting to driver detach volume 54fb8bde-5953-4aa4-ad80-0e14e1690582 from mountpoint /dev/vdb
Apr 13 19:15:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Attempting to detach device vdb from instance 080204b2-fd4d-4224-b391-a27036d058ac from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:15:03 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:15:03 user nova-compute[71692]:   <source dev="/dev/sdf"/>
Apr 13 19:15:03 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:15:03 user nova-compute[71692]:   <serial>54fb8bde-5953-4aa4-ad80-0e14e1690582</serial>
Apr 13 19:15:03 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:15:03 user nova-compute[71692]: </disk>
Apr 13 19:15:03 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:15:03 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Successfully detached device vdb from instance 080204b2-fd4d-4224-b391-a27036d058ac from the persistent domain config.
Apr 13 19:15:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 080204b2-fd4d-4224-b391-a27036d058ac from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:15:03 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:15:03 user nova-compute[71692]:   <source dev="/dev/sdf"/>
Apr 13 19:15:03 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:15:03 user nova-compute[71692]:   <serial>54fb8bde-5953-4aa4-ad80-0e14e1690582</serial>
Apr 13 19:15:03 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:15:03 user nova-compute[71692]: </disk>
Apr 13 19:15:03 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681413303.8401773, 080204b2-fd4d-4224-b391-a27036d058ac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:15:03 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Successfully detached device vdb from instance 080204b2-fd4d-4224-b391-a27036d058ac from the live domain config.
Apr 13 19:15:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lqjLSBCI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:15:03 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:15:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f62bcd-4b79-4143-ac8c-40dde50c6a46]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:15:03 user nova-compute[71692]: No targets found.
Apr 13 19:15:03 user nova-compute[71692]: iSNS:
Apr 13 19:15:03 user nova-compute[71692]: No targets found.
Apr 13 19:15:03 user nova-compute[71692]: STATIC:
Apr 13 19:15:03 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7
Apr 13 19:15:03 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:15:03 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:15:03 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959
Apr 13 19:15:03 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:15:03 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:15:03 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185
Apr 13 19:15:03 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:15:03 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:15:03 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582
Apr 13 19:15:03 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:15:03 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:15:03 user nova-compute[71692]: FIRMWARE:
Apr 13 19:15:03 user nova-compute[71692]: No targets found.
Apr 13 19:15:03 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:15:03 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:15:03 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[266e6553-d909-4970-855d-3cad0211252f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b795e23-80f0-4963-b33d-37ba08c968e6]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:15:03 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:15:03 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:15:03 user nova-compute[71692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 (non-flash)
Apr 13 19:15:03 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:15:03 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:15:03 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:15:03 user nova-compute[71692]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 (non-flash)
Apr 13 19:15:03 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc659b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582'): ({'sdf'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Removing single pathed devices sdf {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7767810a-ab58-4482-949b-f552cbea1ce3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffcf9cd-d87f-4fb1-94ae-c14601a1ba68]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Flushing IO for device /dev/sdf {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[28af89d3-c8b6-4196-b88b-78fe0f58bf59]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:15:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f128fb91-03cc-4f87-9c6b-2a50142d8b75]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] SCSI volumes sdf have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fdcd10-cf82-4b38-935c-0a14f2fc08bb]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0bf84e-fc86-4385-b443-458c96ea10bf]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582, portal: 172.16.0.220,3260]
Apr 13 19:15:04 user nova-compute[71692]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582, portal: 172.16.0.220,3260] successful.
Apr 13 19:15:04 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54fb8bde-5953-4aa4-ad80-0e14e1690582 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7958833c-65f1-40bd-a027-68d5cf687a55]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] <== disconnect_volume: return (315ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:15:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:05 user nova-compute[71692]: DEBUG nova.objects.instance [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'flavor' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:15:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c8b2fe10-a67d-461a-8634-f136c41a0411 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.770s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Starting finish_migration {{(pid=71692) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Instance directory exists: not creating {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 19:15:06 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Creating image(s)
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Did not create local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Ensure instance console log exists: /opt/stack/data/nova/instances/a9f3d080-a163-4897-9187-2687cae49694/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Start _get_guest_xml network_info=[{"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-383984590-network", "vif_mac": "fa:16:3e:7b:c7:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'f92220e3-e7db-41ff-94d1-a827e595c87d', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTPAhqcO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a9f3d080-a163-4897-9187-2687cae49694', 'attached_at': '2023-04-13T19:15:06.000000', 'detached_at': '', 'volume_id': '7cde3ec4-f279-44f2-927c-45ce0d350ca2', 'serial': '7cde3ec4-f279-44f2-927c-45ce0d350ca2'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:15:06 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:15:06 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:54:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.objects.instance [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'vcpu_model' on Instance uuid a9f3d080-a163-4897-9187-2687cae49694 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTPAhqcO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:15:06 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:15:06 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:15:06 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a854175f-f511-45a2-9de3-44122ba6e61e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:15:06 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f482a3a-888c-44fa-884c-a3bb3083f275]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2] added
Apr 13 19:15:06 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6030ea-f9d2-4e5d-ac05-04d19b71d0df]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eda727-c944-4e43-a5c1-da8dfd6fa8fe]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTPAhqcO {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UTPAhqcO" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0dfc31-bd64-4caf-acb1-e2f05f41ce46]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UTPAhqcO'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd51743-0e58-4611-bdba-083666304afd]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[981e8653-b7eb-48ac-8e1e-70b17b31dbf1]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:15:06 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:15:06 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:15:06 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:15:06 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:15:06 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:15:06 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9044a4-9cb9-4ed2-bffe-cba1e1604617]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2, portal: 172.16.0.220,3260]
Apr 13 19:15:06 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2, portal: 172.16.0.220,3260] successful.
Apr 13 19:15:06 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fac3a18-6302-43b9-ab8f-19438e71feb7]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[19550157-e52f-4bb2-9bb6-079a1ca9bc20]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:15:06 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:15:06 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:15:06 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:15:06 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:15:06 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:15:06 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:15:06 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:15:06 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dea1bf9-87cd-412a-a533-02dea7755eed]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:15:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTPAhqcO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23935373435633432', 'path': '/dev/sdb'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935373435633432', 'path': '/dev/sdb'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1898726378',display_name='tempest-ServerActionsTestJSON-server-1898726378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1898726378',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:13:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-z4fn11mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:15:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=a9f3d080-a163-4897-9187-2687cae49694,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-383984590-network", "vif_mac": "fa:16:3e:7b:c7:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-383984590-network", "vif_mac": "fa:16:3e:7b:c7:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=2207b77c-fc08-471c-8281-cd1f6061ea54,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2207b77c-fc') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:15:07 user nova-compute[71692]:   <uuid>a9f3d080-a163-4897-9187-2687cae49694</uuid>
Apr 13 19:15:07 user nova-compute[71692]:   <name>instance-0000001d</name>
Apr 13 19:15:07 user nova-compute[71692]:   <memory>196608</memory>
Apr 13 19:15:07 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:15:07 user nova-compute[71692]:   <metadata>
Apr 13 19:15:07 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:15:07 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:15:07 user nova-compute[71692]:       <nova:name>tempest-ServerActionsTestJSON-server-1898726378</nova:name>
Apr 13 19:15:07 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:15:06</nova:creationTime>
Apr 13 19:15:07 user nova-compute[71692]:       <nova:flavor name="m1.micro">
Apr 13 19:15:07 user nova-compute[71692]:         <nova:memory>192</nova:memory>
Apr 13 19:15:07 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:15:07 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:15:07 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:15:07 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:15:07 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:15:07 user nova-compute[71692]:       <nova:owner>
Apr 13 19:15:07 user nova-compute[71692]:         <nova:user uuid="df209814208d415e9d414d39205aaad6">tempest-ServerActionsTestJSON-1901931474-project-member</nova:user>
Apr 13 19:15:07 user nova-compute[71692]:         <nova:project uuid="c162f91cba4b4ecf9de48fbf839da261">tempest-ServerActionsTestJSON-1901931474</nova:project>
Apr 13 19:15:07 user nova-compute[71692]:       </nova:owner>
Apr 13 19:15:07 user nova-compute[71692]:       <nova:ports>
Apr 13 19:15:07 user nova-compute[71692]:         <nova:port uuid="2207b77c-fc08-471c-8281-cd1f6061ea54">
Apr 13 19:15:07 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 19:15:07 user nova-compute[71692]:         </nova:port>
Apr 13 19:15:07 user nova-compute[71692]:       </nova:ports>
Apr 13 19:15:07 user nova-compute[71692]:     </nova:instance>
Apr 13 19:15:07 user nova-compute[71692]:   </metadata>
Apr 13 19:15:07 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:15:07 user nova-compute[71692]:     <system>
Apr 13 19:15:07 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:15:07 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:15:07 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:15:07 user nova-compute[71692]:       <entry name="serial">a9f3d080-a163-4897-9187-2687cae49694</entry>
Apr 13 19:15:07 user nova-compute[71692]:       <entry name="uuid">a9f3d080-a163-4897-9187-2687cae49694</entry>
Apr 13 19:15:07 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:15:07 user nova-compute[71692]:     </system>
Apr 13 19:15:07 user nova-compute[71692]:   </sysinfo>
Apr 13 19:15:07 user nova-compute[71692]:   <os>
Apr 13 19:15:07 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:15:07 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:15:07 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:15:07 user nova-compute[71692]:   </os>
Apr 13 19:15:07 user nova-compute[71692]:   <features>
Apr 13 19:15:07 user nova-compute[71692]:     <acpi/>
Apr 13 19:15:07 user nova-compute[71692]:     <apic/>
Apr 13 19:15:07 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:15:07 user nova-compute[71692]:   </features>
Apr 13 19:15:07 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:15:07 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:15:07 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:15:07 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:15:07 user nova-compute[71692]:   </clock>
Apr 13 19:15:07 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:15:07 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:15:07 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:15:07 user nova-compute[71692]:   </cpu>
Apr 13 19:15:07 user nova-compute[71692]:   <devices>
Apr 13 19:15:07 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:15:07 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:15:07 user nova-compute[71692]:       <source dev="/dev/sdb"/>
Apr 13 19:15:07 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:15:07 user nova-compute[71692]:       <serial>7cde3ec4-f279-44f2-927c-45ce0d350ca2</serial>
Apr 13 19:15:07 user nova-compute[71692]:     </disk>
Apr 13 19:15:07 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:15:07 user nova-compute[71692]:       <mac address="fa:16:3e:7b:c7:2f"/>
Apr 13 19:15:07 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:15:07 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:15:07 user nova-compute[71692]:       <target dev="tap2207b77c-fc"/>
Apr 13 19:15:07 user nova-compute[71692]:     </interface>
Apr 13 19:15:07 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:15:07 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/a9f3d080-a163-4897-9187-2687cae49694/console.log" append="off"/>
Apr 13 19:15:07 user nova-compute[71692]:     </serial>
Apr 13 19:15:07 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:15:07 user nova-compute[71692]:     <video>
Apr 13 19:15:07 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:15:07 user nova-compute[71692]:     </video>
Apr 13 19:15:07 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:15:07 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:15:07 user nova-compute[71692]:     </rng>
Apr 13 19:15:07 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:15:07 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:15:07 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:15:07 user nova-compute[71692]:     </memballoon>
Apr 13 19:15:07 user nova-compute[71692]:   </devices>
Apr 13 19:15:07 user nova-compute[71692]: </domain>
Apr 13 19:15:07 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1898726378',display_name='tempest-ServerActionsTestJSON-server-1898726378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1898726378',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:13:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-z4fn11mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:15:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=a9f3d080-a163-4897-9187-2687cae49694,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-383984590-network", "vif_mac": "fa:16:3e:7b:c7:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-383984590-network", "vif_mac": "fa:16:3e:7b:c7:2f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=2207b77c-fc08-471c-8281-cd1f6061ea54,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2207b77c-fc') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG os_vif [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=2207b77c-fc08-471c-8281-cd1f6061ea54,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2207b77c-fc') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2207b77c-fc, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2207b77c-fc, col_values=(('external_ids', {'iface-id': '2207b77c-fc08-471c-8281-cd1f6061ea54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:c7:2f', 'vm-uuid': 'a9f3d080-a163-4897-9187-2687cae49694'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:07 user nova-compute[71692]: INFO os_vif [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=2207b77c-fc08-471c-8281-cd1f6061ea54,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2207b77c-fc')
Apr 13 19:15:07 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:15:07 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] No VIF found with MAC fa:16:3e:7b:c7:2f, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:15:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:08 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413293.7899206, 1d7439c2-317e-4454-905f-dc8e59bc49e8 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:15:08 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] VM Stopped (Lifecycle Event)
Apr 13 19:15:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c7e53cb2-eb87-428e-bfdc-ff2bd179d7e5 None None] [instance: 1d7439c2-317e-4454-905f-dc8e59bc49e8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:15:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:09 user nova-compute[71692]: DEBUG nova.compute.manager [req-3c8690ea-5161-4ea0-92f0-f1c41ba2c322 req-4da78276-c69f-4b09-8c11-1a7453612aa1 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:15:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3c8690ea-5161-4ea0-92f0-f1c41ba2c322 req-4da78276-c69f-4b09-8c11-1a7453612aa1 service nova] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3c8690ea-5161-4ea0-92f0-f1c41ba2c322 req-4da78276-c69f-4b09-8c11-1a7453612aa1 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3c8690ea-5161-4ea0-92f0-f1c41ba2c322 req-4da78276-c69f-4b09-8c11-1a7453612aa1 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:09 user nova-compute[71692]: DEBUG nova.compute.manager [req-3c8690ea-5161-4ea0-92f0-f1c41ba2c322 req-4da78276-c69f-4b09-8c11-1a7453612aa1 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] No waiting events found dispatching network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:15:09 user nova-compute[71692]: WARNING nova.compute.manager [req-3c8690ea-5161-4ea0-92f0-f1c41ba2c322 req-4da78276-c69f-4b09-8c11-1a7453612aa1 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received unexpected event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 for instance with vm_state active and task_state resize_finish.
Apr 13 19:15:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Removed pending event for a9f3d080-a163-4897-9187-2687cae49694 due to event {{(pid=71692) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 19:15:10 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413310.8725815, a9f3d080-a163-4897-9187-2687cae49694 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:15:10 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] VM Resumed (Lifecycle Event)
Apr 13 19:15:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:15:10 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: a9f3d080-a163-4897-9187-2687cae49694] Instance running successfully.
Apr 13 19:15:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Failed to set time: agent not configured {{(pid=71692) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 13 19:15:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a193d48e-9e07-4c20-b398-bf65bcf7800f tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] finish_migration finished successfully. {{(pid=71692) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 13 19:15:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:15:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:15:10 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 19:15:10 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413310.8735862, a9f3d080-a163-4897-9187-2687cae49694 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:15:10 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] VM Started (Lifecycle Event)
Apr 13 19:15:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:15:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:15:10 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 19:15:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "e9428f3f-1910-421d-be9c-7ca42fa46334" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "e9428f3f-1910-421d-be9c-7ca42fa46334" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "e9428f3f-1910-421d-be9c-7ca42fa46334-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "e9428f3f-1910-421d-be9c-7ca42fa46334-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "e9428f3f-1910-421d-be9c-7ca42fa46334-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:11 user nova-compute[71692]: INFO nova.compute.manager [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Terminating instance
Apr 13 19:15:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-fa57e954-db68-4ccb-afd5-3c0b805344fa req-20fefa54-48c5-4bf7-8de8-4f20432c8979 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-fa57e954-db68-4ccb-afd5-3c0b805344fa req-20fefa54-48c5-4bf7-8de8-4f20432c8979 service nova] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-fa57e954-db68-4ccb-afd5-3c0b805344fa req-20fefa54-48c5-4bf7-8de8-4f20432c8979 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-fa57e954-db68-4ccb-afd5-3c0b805344fa req-20fefa54-48c5-4bf7-8de8-4f20432c8979 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-fa57e954-db68-4ccb-afd5-3c0b805344fa req-20fefa54-48c5-4bf7-8de8-4f20432c8979 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] No waiting events found dispatching network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:15:11 user nova-compute[71692]: WARNING nova.compute.manager [req-fa57e954-db68-4ccb-afd5-3c0b805344fa req-20fefa54-48c5-4bf7-8de8-4f20432c8979 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received unexpected event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 for instance with vm_state resized and task_state None.
Apr 13 19:15:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-236de2dd-8f30-4f82-af62-a511fb166ca4 req-86b4d55e-5e2a-4638-a1ed-070ba92353bd service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Received event network-vif-unplugged-06aa9cb5-cf77-482a-8292-b82631f08459 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-236de2dd-8f30-4f82-af62-a511fb166ca4 req-86b4d55e-5e2a-4638-a1ed-070ba92353bd service nova] Acquiring lock "e9428f3f-1910-421d-be9c-7ca42fa46334-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-236de2dd-8f30-4f82-af62-a511fb166ca4 req-86b4d55e-5e2a-4638-a1ed-070ba92353bd service nova] Lock "e9428f3f-1910-421d-be9c-7ca42fa46334-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-236de2dd-8f30-4f82-af62-a511fb166ca4 req-86b4d55e-5e2a-4638-a1ed-070ba92353bd service nova] Lock "e9428f3f-1910-421d-be9c-7ca42fa46334-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-236de2dd-8f30-4f82-af62-a511fb166ca4 req-86b4d55e-5e2a-4638-a1ed-070ba92353bd service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] No waiting events found dispatching network-vif-unplugged-06aa9cb5-cf77-482a-8292-b82631f08459 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG nova.compute.manager [req-236de2dd-8f30-4f82-af62-a511fb166ca4 req-86b4d55e-5e2a-4638-a1ed-070ba92353bd service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Received event network-vif-unplugged-06aa9cb5-cf77-482a-8292-b82631f08459 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:11 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Instance destroyed successfully.
Apr 13 19:15:11 user nova-compute[71692]: DEBUG nova.objects.instance [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lazy-loading 'resources' on Instance uuid e9428f3f-1910-421d-be9c-7ca42fa46334 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1162697425',display_name='tempest-VolumesActionsTest-instance-1162697425',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1162697425',id=30,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:13:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2877676ccbd0484d80ecabf3030c0ee4',ramdisk_id='',reservation_id='r-6koo2yvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-427747232',owner_user_name='tempest-VolumesActionsTest-427747232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:13:29Z,user_data=None,user_id='80063ed703d24a1b84aede724db205a7',uuid=e9428f3f-1910-421d-be9c-7ca42fa46334,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06aa9cb5-cf77-482a-8292-b82631f08459", "address": "fa:16:3e:a5:da:5a", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa9cb5-cf", "ovs_interfaceid": "06aa9cb5-cf77-482a-8292-b82631f08459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Converting VIF {"id": "06aa9cb5-cf77-482a-8292-b82631f08459", "address": "fa:16:3e:a5:da:5a", "network": {"id": "b34bf81f-6825-4376-a26c-35386631a4ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1655083614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "2877676ccbd0484d80ecabf3030c0ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06aa9cb5-cf", "ovs_interfaceid": "06aa9cb5-cf77-482a-8292-b82631f08459", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:da:5a,bridge_name='br-int',has_traffic_filtering=True,id=06aa9cb5-cf77-482a-8292-b82631f08459,network=Network(b34bf81f-6825-4376-a26c-35386631a4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aa9cb5-cf') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG os_vif [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:da:5a,bridge_name='br-int',has_traffic_filtering=True,id=06aa9cb5-cf77-482a-8292-b82631f08459,network=Network(b34bf81f-6825-4376-a26c-35386631a4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aa9cb5-cf') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06aa9cb5-cf, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:15:11 user nova-compute[71692]: INFO os_vif [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:da:5a,bridge_name='br-int',has_traffic_filtering=True,id=06aa9cb5-cf77-482a-8292-b82631f08459,network=Network(b34bf81f-6825-4376-a26c-35386631a4ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06aa9cb5-cf')
Apr 13 19:15:11 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Deleting instance files /opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334_del
Apr 13 19:15:11 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Deletion of /opt/stack/data/nova/instances/e9428f3f-1910-421d-be9c-7ca42fa46334_del complete
Apr 13 19:15:11 user nova-compute[71692]: INFO nova.compute.manager [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 13 19:15:11 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:15:11 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:15:12 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:15:12 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Took 0.45 seconds to deallocate network for instance.
Apr 13 19:15:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:12 user nova-compute[71692]: INFO nova.compute.manager [None req-8c956fae-75b3-4282-ace7-3322119f1e8e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Unrescuing
Apr 13 19:15:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8c956fae-75b3-4282-ace7-3322119f1e8e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:15:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8c956fae-75b3-4282-ace7-3322119f1e8e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquired lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:15:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-8c956fae-75b3-4282-ace7-3322119f1e8e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:15:12 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:15:12 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:15:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:12 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Deleted allocations for instance e9428f3f-1910-421d-be9c-7ca42fa46334
Apr 13 19:15:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-14f86590-10f4-499c-bd92-fbfb37f5e20f tempest-VolumesActionsTest-427747232 tempest-VolumesActionsTest-427747232-project-member] Lock "e9428f3f-1910-421d-be9c-7ca42fa46334" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.717s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-8c956fae-75b3-4282-ace7-3322119f1e8e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Updating instance_info_cache with network_info: [{"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:15:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8c956fae-75b3-4282-ace7-3322119f1e8e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Releasing lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:15:12 user nova-compute[71692]: DEBUG nova.objects.instance [None req-8c956fae-75b3-4282-ace7-3322119f1e8e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lazy-loading 'flavor' on Instance uuid 33367b19-4d62-46dc-8346-45ea09c5563d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:15:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-e405edb9-5015-4c9c-827e-532a8daf1df1 req-bbef3485-16eb-4db5-b1d8-80f5425b9ede service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Received event network-vif-plugged-06aa9cb5-cf77-482a-8292-b82631f08459 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:15:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e405edb9-5015-4c9c-827e-532a8daf1df1 req-bbef3485-16eb-4db5-b1d8-80f5425b9ede service nova] Acquiring lock "e9428f3f-1910-421d-be9c-7ca42fa46334-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e405edb9-5015-4c9c-827e-532a8daf1df1 req-bbef3485-16eb-4db5-b1d8-80f5425b9ede service nova] Lock "e9428f3f-1910-421d-be9c-7ca42fa46334-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e405edb9-5015-4c9c-827e-532a8daf1df1 req-bbef3485-16eb-4db5-b1d8-80f5425b9ede service nova] Lock "e9428f3f-1910-421d-be9c-7ca42fa46334-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-e405edb9-5015-4c9c-827e-532a8daf1df1 req-bbef3485-16eb-4db5-b1d8-80f5425b9ede service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] No waiting events found dispatching network-vif-plugged-06aa9cb5-cf77-482a-8292-b82631f08459 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:15:13 user nova-compute[71692]: WARNING nova.compute.manager [req-e405edb9-5015-4c9c-827e-532a8daf1df1 req-bbef3485-16eb-4db5-b1d8-80f5425b9ede service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Received unexpected event network-vif-plugged-06aa9cb5-cf77-482a-8292-b82631f08459 for instance with vm_state deleted and task_state None.
Apr 13 19:15:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-e405edb9-5015-4c9c-827e-532a8daf1df1 req-bbef3485-16eb-4db5-b1d8-80f5425b9ede service nova] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Received event network-vif-deleted-06aa9cb5-cf77-482a-8292-b82631f08459 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:15:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-27646b87-6cd3-42fd-ae2a-3715260e84f4 req-8dee0a0f-2b10-409c-8eb3-c2674ac0b448 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-vif-unplugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:15:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-27646b87-6cd3-42fd-ae2a-3715260e84f4 req-8dee0a0f-2b10-409c-8eb3-c2674ac0b448 service nova] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-27646b87-6cd3-42fd-ae2a-3715260e84f4 req-8dee0a0f-2b10-409c-8eb3-c2674ac0b448 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-27646b87-6cd3-42fd-ae2a-3715260e84f4 req-8dee0a0f-2b10-409c-8eb3-c2674ac0b448 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-27646b87-6cd3-42fd-ae2a-3715260e84f4 req-8dee0a0f-2b10-409c-8eb3-c2674ac0b448 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] No waiting events found dispatching network-vif-unplugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:15:13 user nova-compute[71692]: WARNING nova.compute.manager [req-27646b87-6cd3-42fd-ae2a-3715260e84f4 req-8dee0a0f-2b10-409c-8eb3-c2674ac0b448 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received unexpected event network-vif-unplugged-6d1659d8-90f3-45a5-90a0-772abe02c673 for instance with vm_state rescued and task_state unrescuing.
Apr 13 19:15:13 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Instance destroyed successfully.
Apr 13 19:15:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] No waiting events found dispatching network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:15:15 user nova-compute[71692]: WARNING nova.compute.manager [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received unexpected event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 for instance with vm_state rescued and task_state unrescuing.
Apr 13 19:15:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-changed-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Refreshing instance network info cache due to event network-changed-6d1659d8-90f3-45a5-90a0-772abe02c673. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Acquiring lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Acquired lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:15:15 user nova-compute[71692]: DEBUG nova.network.neutron [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Refreshing network info cache for port 6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:15:16 user nova-compute[71692]: DEBUG nova.network.neutron [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Updated VIF entry in instance network info cache for port 6d1659d8-90f3-45a5-90a0-772abe02c673. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:15:16 user nova-compute[71692]: DEBUG nova.network.neutron [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Updating instance_info_cache with network_info: [{"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:15:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Releasing lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:15:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-changed-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:15:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Refreshing instance network info cache due to event network-changed-6d1659d8-90f3-45a5-90a0-772abe02c673. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:15:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Acquiring lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:15:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Acquired lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:15:16 user nova-compute[71692]: DEBUG nova.network.neutron [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Refreshing network info cache for port 6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:15:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:16 user nova-compute[71692]: DEBUG nova.network.neutron [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Updated VIF entry in instance network info cache for port 6d1659d8-90f3-45a5-90a0-772abe02c673. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:15:16 user nova-compute[71692]: DEBUG nova.network.neutron [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Updating instance_info_cache with network_info: [{"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:15:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Releasing lock "refresh_cache-33367b19-4d62-46dc-8346-45ea09c5563d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:15:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:15:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] No waiting events found dispatching network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:15:17 user nova-compute[71692]: WARNING nova.compute.manager [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received unexpected event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 for instance with vm_state rescued and task_state unrescuing.
Apr 13 19:15:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:15:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] No waiting events found dispatching network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:15:17 user nova-compute[71692]: WARNING nova.compute.manager [req-4bbc3600-4323-4bf8-bb2d-4189a4f4f872 req-9ee8df03-58bb-468c-8edb-285ac9ad07a5 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received unexpected event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 for instance with vm_state rescued and task_state unrescuing.
Apr 13 19:15:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Removed pending event for 33367b19-4d62-46dc-8346-45ea09c5563d due to event {{(pid=71692) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 19:15:17 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413317.2761545, 33367b19-4d62-46dc-8346-45ea09c5563d => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:15:17 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] VM Resumed (Lifecycle Event)
Apr 13 19:15:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8c956fae-75b3-4282-ace7-3322119f1e8e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:15:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:15:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:15:17 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 19:15:17 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413317.2770007, 33367b19-4d62-46dc-8346-45ea09c5563d => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:15:17 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] VM Started (Lifecycle Event)
Apr 13 19:15:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:15:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:15:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:26 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413311.6548285, e9428f3f-1910-421d-be9c-7ca42fa46334 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:15:26 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] VM Stopped (Lifecycle Event)
Apr 13 19:15:26 user nova-compute[71692]: DEBUG nova.compute.manager [None req-7ea2361e-1b19-41c0-a3d4-638b4c6bdf61 None None] [instance: e9428f3f-1910-421d-be9c-7ca42fa46334] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:15:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "33367b19-4d62-46dc-8346-45ea09c5563d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:29 user nova-compute[71692]: INFO nova.compute.manager [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Detaching volume ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185
Apr 13 19:15:29 user nova-compute[71692]: INFO nova.virt.block_device [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Attempting to driver detach volume ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 from mountpoint /dev/vdb
Apr 13 19:15:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Attempting to detach device vdb from instance 33367b19-4d62-46dc-8346-45ea09c5563d from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:15:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:15:29 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:15:29 user nova-compute[71692]:   <source dev="/dev/sdd"/>
Apr 13 19:15:29 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:15:29 user nova-compute[71692]:   <serial>ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185</serial>
Apr 13 19:15:29 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:15:29 user nova-compute[71692]: </disk>
Apr 13 19:15:29 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:15:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Successfully detached device vdb from instance 33367b19-4d62-46dc-8346-45ea09c5563d from the persistent domain config.
Apr 13 19:15:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 33367b19-4d62-46dc-8346-45ea09c5563d from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:15:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:15:29 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:15:29 user nova-compute[71692]:   <source dev="/dev/sdd"/>
Apr 13 19:15:29 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:15:29 user nova-compute[71692]:   <serial>ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185</serial>
Apr 13 19:15:29 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:15:29 user nova-compute[71692]: </disk>
Apr 13 19:15:29 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681413330.2321932, 33367b19-4d62-46dc-8346-45ea09c5563d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 33367b19-4d62-46dc-8346-45ea09c5563d {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:15:30 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Successfully detached device vdb from instance 33367b19-4d62-46dc-8346-45ea09c5563d from the live domain config.
Apr 13 19:15:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAXCiaRg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:15:30 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d073c443-fc90-4296-88ed-870a30592a74]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:15:30 user nova-compute[71692]: No targets found.
Apr 13 19:15:30 user nova-compute[71692]: iSNS:
Apr 13 19:15:30 user nova-compute[71692]: No targets found.
Apr 13 19:15:30 user nova-compute[71692]: STATIC:
Apr 13 19:15:30 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7
Apr 13 19:15:30 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:15:30 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:15:30 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959
Apr 13 19:15:30 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:15:30 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:15:30 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185
Apr 13 19:15:30 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:15:30 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:15:30 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2
Apr 13 19:15:30 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:15:30 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:15:30 user nova-compute[71692]: FIRMWARE:
Apr 13 19:15:30 user nova-compute[71692]: No targets found.
Apr 13 19:15:30 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:15:30 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:15:30 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9fb095-d20e-43d0-b190-9fa0e7864246]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[808d1073-cc67-4d8d-b147-c0f720a0a754]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:15:30 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:15:30 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:15:30 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:15:30 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:15:30 user nova-compute[71692]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 (non-flash)
Apr 13 19:15:30 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:15:30 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:15:30 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc141240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185'): ({'sdd'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Removing single pathed devices sdd {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe58f0c-3f82-41f2-88bb-e4d81509a4d7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f1609d-5a1b-4e57-960f-d3db39f03967]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Flushing IO for device /dev/sdd {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad04a104-4c41-4429-9b12-9d11d4594268]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21c2b30-2c29-4f25-a329-e5b504e23bf4]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[93657896-dc1f-450e-9149-65004d62c301]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9e646d-69c5-4fcc-bd94-d6f0f4e35587]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185, portal: 172.16.0.220,3260]
Apr 13 19:15:30 user nova-compute[71692]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185, portal: 172.16.0.220,3260] successful.
Apr 13 19:15:30 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffe3a0ae-9ef2-49d7-b894-53b6c0c3f185 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf14669f-cb9e-458f-a66b-106aeee04b9e]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] <== disconnect_volume: return (293ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:15:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:15:31 user nova-compute[71692]: DEBUG nova.objects.instance [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lazy-loading 'flavor' on Instance uuid 33367b19-4d62-46dc-8346-45ea09c5563d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:15:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-19b29056-6d2f-4462-8039-d92f18035c80 tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "33367b19-4d62-46dc-8346-45ea09c5563d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.796s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:38 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:15:39 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:15:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:42 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:15:42 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:15:43 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:15:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:44 user nova-compute[71692]: INFO nova.compute.manager [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Detaching volume cc03d2f5-5d25-4ada-bde0-5c2d270b60f7
Apr 13 19:15:44 user nova-compute[71692]: INFO nova.virt.block_device [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Attempting to driver detach volume cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 from mountpoint /dev/vdb
Apr 13 19:15:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Attempting to detach device vdb from instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:15:44 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:15:44 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:15:44 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:15:44 user nova-compute[71692]:   <serial>cc03d2f5-5d25-4ada-bde0-5c2d270b60f7</serial>
Apr 13 19:15:44 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:15:44 user nova-compute[71692]: </disk>
Apr 13 19:15:44 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:15:44 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Successfully detached device vdb from instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d from the persistent domain config.
Apr 13 19:15:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:15:44 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:15:44 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:15:44 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:15:44 user nova-compute[71692]:   <serial>cc03d2f5-5d25-4ada-bde0-5c2d270b60f7</serial>
Apr 13 19:15:44 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:15:44 user nova-compute[71692]: </disk>
Apr 13 19:15:44 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681413344.8581784, ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:15:44 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Successfully detached device vdb from instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d from the live domain config.
Apr 13 19:15:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIHxjTbq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:15:44 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:15:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac0def9-a808-45c8-b98d-4a766f6c04e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:15:44 user nova-compute[71692]: No targets found.
Apr 13 19:15:44 user nova-compute[71692]: iSNS:
Apr 13 19:15:44 user nova-compute[71692]: No targets found.
Apr 13 19:15:44 user nova-compute[71692]: STATIC:
Apr 13 19:15:44 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7
Apr 13 19:15:44 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:15:44 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:15:44 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959
Apr 13 19:15:44 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:15:44 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:15:44 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2
Apr 13 19:15:44 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:15:44 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:15:44 user nova-compute[71692]: FIRMWARE:
Apr 13 19:15:44 user nova-compute[71692]: No targets found.
Apr 13 19:15:44 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:15:44 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:15:44 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6681e39e-b522-448e-ac63-9f2334b20cbb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b0ce1f-83d8-43fa-9362-faf08cf78256]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:15:44 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:15:44 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:15:44 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 (non-flash)
Apr 13 19:15:44 user nova-compute[71692]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:15:44 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:15:44 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febc42c7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7'): ({'sdc'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Removing single pathed devices sdc {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2796d992-897d-4010-949d-78ead9e51c0d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6386ad6-4dbc-489a-b5f3-22d0bd6e7a93]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flushing IO for device /dev/sdc {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:15:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf41f0f7-a527-4282-b9c8-d512fdde6b2b]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e04bd1-73c7-4d8d-be9a-d1aa0e2d14cf]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8b9bf0-5a43-421b-ba1a-0c54cafc1e8c]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b918921-6cb0-4b43-b60e-46fd2e11133e]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7, portal: 172.16.0.220,3260]
Apr 13 19:15:45 user nova-compute[71692]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7, portal: 172.16.0.220,3260] successful.
Apr 13 19:15:45 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc03d2f5-5d25-4ada-bde0-5c2d270b60f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c41d82-5e32-46db-89a7-c160f9ee9160]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] <== disconnect_volume: return (314ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:15:45 user nova-compute[71692]: DEBUG nova.objects.instance [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'flavor' on Instance uuid ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f459d368-85d5-4d74-980c-8c3ec2faa54c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.695s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Updating instance_info_cache with network_info: [{"id": "e124e179-0315-423a-b9cf-c232753845ed", "address": "fa:16:3e:1a:cf:e4", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape124e179-03", "ovs_interfaceid": "e124e179-0315-423a-b9cf-c232753845ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:15:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk.rescue --force-share --output=json" returned: 0 in 0.127s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:15:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:49 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:15:49 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:15:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=7894MB free_disk=25.981395721435547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:15:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Applying migration context for instance a9f3d080-a163-4897-9187-2687cae49694 as it has an incoming, in-progress migration 9a0976be-7ccb-41ea-a57f-8d3dcd983361. Migration status is finished {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 19:15:49 user nova-compute[71692]: INFO nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] Updating resource usage from migration 9a0976be-7ccb-41ea-a57f-8d3dcd983361
Apr 13 19:15:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:15:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 59d7b86a-c723-4255-827e-2f6a641239df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:15:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 33367b19-4d62-46dc-8346-45ea09c5563d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:15:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:15:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 579c83e7-7976-47f4-9f25-a194e39966ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:15:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 01bd39f7-7d27-48cf-982e-181aadc060ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:15:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 080204b2-fd4d-4224-b391-a27036d058ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:15:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Migration 9a0976be-7ccb-41ea-a57f-8d3dcd983361 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 19:15:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance a9f3d080-a163-4897-9187-2687cae49694 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:15:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:15:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:15:49 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:15:50 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:15:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:15:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:50 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:15:50 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:15:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG nova.objects.instance [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'flavor' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:15:56 user nova-compute[71692]: INFO nova.compute.manager [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Attaching volume 391615e7-83e5-4e38-bf6d-80450b7b687b to /dev/vdb
Apr 13 19:15:56 user nova-compute[71692]: DEBUG os_brick.utils [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e623b38c-ec1a-42f3-9b1d-07bd19b0f2d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d022c188-8527-40b9-ad91-fc5734f81a93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcc4d2e-1cef-4321-b199-d4911960de5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4e9580-d99c-4994-886e-5ba2aa82923e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:15:56 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:15:56 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4ba5c0-bd9b-4a3b-b9e8-b2fd6d27afbe]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG os_brick.utils [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Updating existing volume attachment record: 7bacd04f-586d-44da-ba1d-3f2da6abe21a {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:15:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:16:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LSGaYojB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:16:00 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:16:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:16:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:16:00 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:16:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:16:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:16:00 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:16:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:00 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60b955e-bb86-46b2-8ba6-0e9701064478]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:16:00 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:16:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:00 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3955fc7-f89b-4b02-adcd-14add53988b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b] added
Apr 13 19:16:00 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5388251-0f73-44da-8a93-1c1b62b11835]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94487d3-2ad4-49c0-9933-123996c00441]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LSGaYojB {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LSGaYojB" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c08df15-9fe2-4a9f-9326-1eb01adde4f4]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LSGaYojB'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[837697e7-1027-4de2-8f62-29deb82a4581]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b583f7-a4fb-4c87-83d8-d391b4273c58]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:16:01 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:16:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:16:01 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:16:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2749e63-fcf6-4688-83fe-557e2e02e099]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b, portal: 172.16.0.220,3260]
Apr 13 19:16:01 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b, portal: 172.16.0.220,3260] successful.
Apr 13 19:16:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93dfd83-1c4e-42fa-96c7-4c4d02494431]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f519b675-eaed-4033-af36-8845b54c4a88]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:16:01 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:16:01 user nova-compute[71692]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b (non-flash)
Apr 13 19:16:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:16:01 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:16:01 user nova-compute[71692]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b (non-flash)
Apr 13 19:16:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfd68af-6789-4799-b8c4-3851491b3a96]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LSGaYojB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:16:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23433303866333161', 'path': '/dev/sdc'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:16:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433303866333161', 'path': '/dev/sdc'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:16:02 user nova-compute[71692]: DEBUG nova.objects.instance [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'flavor' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:16:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:16:02 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:16:02 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:16:02 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:16:02 user nova-compute[71692]:   <serial>391615e7-83e5-4e38-bf6d-80450b7b687b</serial>
Apr 13 19:16:02 user nova-compute[71692]: </disk>
Apr 13 19:16:02 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:16:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:16:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:16:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] No VIF found with MAC fa:16:3e:8e:c2:1f, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:16:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9200e196-4ac0-4525-8bcc-a99207c7fa68 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.297s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:03 user nova-compute[71692]: INFO nova.compute.manager [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Detaching volume 391615e7-83e5-4e38-bf6d-80450b7b687b
Apr 13 19:16:03 user nova-compute[71692]: INFO nova.virt.block_device [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Attempting to driver detach volume 391615e7-83e5-4e38-bf6d-80450b7b687b from mountpoint /dev/vdb
Apr 13 19:16:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Attempting to detach device vdb from instance 080204b2-fd4d-4224-b391-a27036d058ac from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:16:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:16:03 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:16:03 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:16:03 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:16:03 user nova-compute[71692]:   <serial>391615e7-83e5-4e38-bf6d-80450b7b687b</serial>
Apr 13 19:16:03 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:16:03 user nova-compute[71692]: </disk>
Apr 13 19:16:03 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:16:03 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Successfully detached device vdb from instance 080204b2-fd4d-4224-b391-a27036d058ac from the persistent domain config.
Apr 13 19:16:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 080204b2-fd4d-4224-b391-a27036d058ac from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:16:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:16:03 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:16:03 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:16:03 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:16:03 user nova-compute[71692]:   <serial>391615e7-83e5-4e38-bf6d-80450b7b687b</serial>
Apr 13 19:16:03 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:16:03 user nova-compute[71692]: </disk>
Apr 13 19:16:03 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681413364.0156748, 080204b2-fd4d-4224-b391-a27036d058ac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:16:04 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Successfully detached device vdb from instance 080204b2-fd4d-4224-b391-a27036d058ac from the live domain config.
Apr 13 19:16:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LSGaYojB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:16:04 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e21e14-1635-4740-8c49-47cc2f20e4b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:16:04 user nova-compute[71692]: No targets found.
Apr 13 19:16:04 user nova-compute[71692]: iSNS:
Apr 13 19:16:04 user nova-compute[71692]: No targets found.
Apr 13 19:16:04 user nova-compute[71692]: STATIC:
Apr 13 19:16:04 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959
Apr 13 19:16:04 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:16:04 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:16:04 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b
Apr 13 19:16:04 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:16:04 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:16:04 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2
Apr 13 19:16:04 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:16:04 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:16:04 user nova-compute[71692]: FIRMWARE:
Apr 13 19:16:04 user nova-compute[71692]: No targets found.
Apr 13 19:16:04 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:16:04 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:16:04 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[994ff16f-18a8-4d2d-ae98-29d8ab8eb190]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[817a7194-5524-4c3e-9b4d-a9e8a61c9627]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:16:04 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:16:04 user nova-compute[71692]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b (non-flash)
Apr 13 19:16:04 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:16:04 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:16:04 user nova-compute[71692]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b (non-flash)
Apr 13 19:16:04 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febd588b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b'): ({'sdc'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Removing single pathed devices sdc {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[852abbe0-309a-4072-879b-a8275e741dd6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7990c94b-2ffc-43f7-9d01-8321376b2029]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Flushing IO for device /dev/sdc {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a08a805-3ce7-430d-8125-927cb8f05539]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fb1063-3944-4d26-b8fe-4f7238b7a60a]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[264ad9ae-fa34-40a8-a9e2-4e375eb81110]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02ded8a-88a4-4346-a9fd-2cf1100c5215]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b, portal: 172.16.0.220,3260]
Apr 13 19:16:04 user nova-compute[71692]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b, portal: 172.16.0.220,3260] successful.
Apr 13 19:16:04 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:391615e7-83e5-4e38-bf6d-80450b7b687b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b225557-d11f-4485-b30a-9df566a1e9b7]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] <== disconnect_volume: return (299ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:16:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:16:05 user nova-compute[71692]: DEBUG nova.objects.instance [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'flavor' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:16:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-df9bed7b-61c0-414a-b527-e2055aef8cb5 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.656s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:09 user nova-compute[71692]: INFO nova.compute.manager [None req-36a9b68a-1264-4221-8782-16b55267b3de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Unrescuing
Apr 13 19:16:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-36a9b68a-1264-4221-8782-16b55267b3de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:16:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-36a9b68a-1264-4221-8782-16b55267b3de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquired lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:16:09 user nova-compute[71692]: DEBUG nova.network.neutron [None req-36a9b68a-1264-4221-8782-16b55267b3de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:16:10 user nova-compute[71692]: DEBUG nova.network.neutron [None req-36a9b68a-1264-4221-8782-16b55267b3de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Updating instance_info_cache with network_info: [{"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:16:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-36a9b68a-1264-4221-8782-16b55267b3de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Releasing lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:16:10 user nova-compute[71692]: DEBUG nova.objects.instance [None req-36a9b68a-1264-4221-8782-16b55267b3de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'flavor' on Instance uuid 01bd39f7-7d27-48cf-982e-181aadc060ab {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:16:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:10 user nova-compute[71692]: DEBUG nova.compute.manager [req-32f831dc-bd53-4b73-ab59-1e0fb28cab34 req-f690350a-872f-4123-8f28-c3557ed37ed3 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-vif-unplugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:16:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-32f831dc-bd53-4b73-ab59-1e0fb28cab34 req-f690350a-872f-4123-8f28-c3557ed37ed3 service nova] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-32f831dc-bd53-4b73-ab59-1e0fb28cab34 req-f690350a-872f-4123-8f28-c3557ed37ed3 service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-32f831dc-bd53-4b73-ab59-1e0fb28cab34 req-f690350a-872f-4123-8f28-c3557ed37ed3 service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:10 user nova-compute[71692]: DEBUG nova.compute.manager [req-32f831dc-bd53-4b73-ab59-1e0fb28cab34 req-f690350a-872f-4123-8f28-c3557ed37ed3 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] No waiting events found dispatching network-vif-unplugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:16:10 user nova-compute[71692]: WARNING nova.compute.manager [req-32f831dc-bd53-4b73-ab59-1e0fb28cab34 req-f690350a-872f-4123-8f28-c3557ed37ed3 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received unexpected event network-vif-unplugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance with vm_state rescued and task_state unrescuing.
Apr 13 19:16:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:11 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Instance destroyed successfully.
Apr 13 19:16:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-6de72cea-3a01-4356-9441-0bc40720b3d7 req-ff0dc9fe-8ccf-4e52-a410-d0ab15ea5fe9 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:16:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6de72cea-3a01-4356-9441-0bc40720b3d7 req-ff0dc9fe-8ccf-4e52-a410-d0ab15ea5fe9 service nova] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6de72cea-3a01-4356-9441-0bc40720b3d7 req-ff0dc9fe-8ccf-4e52-a410-d0ab15ea5fe9 service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6de72cea-3a01-4356-9441-0bc40720b3d7 req-ff0dc9fe-8ccf-4e52-a410-d0ab15ea5fe9 service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-6de72cea-3a01-4356-9441-0bc40720b3d7 req-ff0dc9fe-8ccf-4e52-a410-d0ab15ea5fe9 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] No waiting events found dispatching network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:16:12 user nova-compute[71692]: WARNING nova.compute.manager [req-6de72cea-3a01-4356-9441-0bc40720b3d7 req-ff0dc9fe-8ccf-4e52-a410-d0ab15ea5fe9 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received unexpected event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance with vm_state rescued and task_state unrescuing.
Apr 13 19:16:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Removed pending event for 01bd39f7-7d27-48cf-982e-181aadc060ab due to event {{(pid=71692) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 19:16:14 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413374.6893668, 01bd39f7-7d27-48cf-982e-181aadc060ab => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:16:14 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] VM Resumed (Lifecycle Event)
Apr 13 19:16:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-36a9b68a-1264-4221-8782-16b55267b3de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:16:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:16:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:16:14 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 19:16:14 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413374.6904118, 01bd39f7-7d27-48cf-982e-181aadc060ab => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:16:14 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] VM Started (Lifecycle Event)
Apr 13 19:16:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:16:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] No waiting events found dispatching network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:16:14 user nova-compute[71692]: WARNING nova.compute.manager [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received unexpected event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance with vm_state active and task_state None.
Apr 13 19:16:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:16:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] No waiting events found dispatching network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:16:14 user nova-compute[71692]: WARNING nova.compute.manager [req-21770d24-88fb-4552-b6ab-4b06cc8fc71d req-99ea221b-53be-45b9-86f3-6de8693d2c64 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received unexpected event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance with vm_state active and task_state None.
Apr 13 19:16:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:16:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:16:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:16:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:16:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:16:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:16:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "33367b19-4d62-46dc-8346-45ea09c5563d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:25 user nova-compute[71692]: INFO nova.compute.manager [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Terminating instance
Apr 13 19:16:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG nova.compute.manager [req-de669163-4031-46d3-8ad7-c328b2fd69a3 req-2e4e0800-27cd-4830-90fc-a32eae8cc433 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-vif-unplugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-de669163-4031-46d3-8ad7-c328b2fd69a3 req-2e4e0800-27cd-4830-90fc-a32eae8cc433 service nova] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-de669163-4031-46d3-8ad7-c328b2fd69a3 req-2e4e0800-27cd-4830-90fc-a32eae8cc433 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-de669163-4031-46d3-8ad7-c328b2fd69a3 req-2e4e0800-27cd-4830-90fc-a32eae8cc433 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG nova.compute.manager [req-de669163-4031-46d3-8ad7-c328b2fd69a3 req-2e4e0800-27cd-4830-90fc-a32eae8cc433 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] No waiting events found dispatching network-vif-unplugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG nova.compute.manager [req-de669163-4031-46d3-8ad7-c328b2fd69a3 req-2e4e0800-27cd-4830-90fc-a32eae8cc433 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-vif-unplugged-6d1659d8-90f3-45a5-90a0-772abe02c673 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:25 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Instance destroyed successfully.
Apr 13 19:16:25 user nova-compute[71692]: DEBUG nova.objects.instance [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lazy-loading 'resources' on Instance uuid 33367b19-4d62-46dc-8346-45ea09c5563d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-972621465',display_name='tempest-ServerStableDeviceRescueTest-server-972621465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-972621465',id=22,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/81JXVWb0rXwxJzcsxAa/8RybinXrc8Zl6qDPwrsL1kZEKNSUSm9I+Uhv2Knu1MvtLPpX14zkVbAGUt4k2gfpkYtA+Jt4hwEGaqZykAeWlkK9tm3g1d//gn87QHubXOQ==',key_name='tempest-keypair-822105464',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:13:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7e1ef6e7b159468f90cfc0db2e8e904d',ramdisk_id='',reservation_id='r-p6e0pmxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-192327838',owner_user_name='tempest-ServerStableDeviceRescueTest-192327838-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:15:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4a9282b733244da9bf210ddc66b74816',uuid=33367b19-4d62-46dc-8346-45ea09c5563d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Converting VIF {"id": "6d1659d8-90f3-45a5-90a0-772abe02c673", "address": "fa:16:3e:ac:21:e1", "network": {"id": "12044ffa-ff1e-492a-b819-a301af851941", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1250319107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7e1ef6e7b159468f90cfc0db2e8e904d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d1659d8-90", "ovs_interfaceid": "6d1659d8-90f3-45a5-90a0-772abe02c673", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:21:e1,bridge_name='br-int',has_traffic_filtering=True,id=6d1659d8-90f3-45a5-90a0-772abe02c673,network=Network(12044ffa-ff1e-492a-b819-a301af851941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d1659d8-90') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG os_vif [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:21:e1,bridge_name='br-int',has_traffic_filtering=True,id=6d1659d8-90f3-45a5-90a0-772abe02c673,network=Network(12044ffa-ff1e-492a-b819-a301af851941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d1659d8-90') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d1659d8-90, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:25 user nova-compute[71692]: INFO os_vif [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:21:e1,bridge_name='br-int',has_traffic_filtering=True,id=6d1659d8-90f3-45a5-90a0-772abe02c673,network=Network(12044ffa-ff1e-492a-b819-a301af851941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d1659d8-90')
Apr 13 19:16:25 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Deleting instance files /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d_del
Apr 13 19:16:25 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Deletion of /opt/stack/data/nova/instances/33367b19-4d62-46dc-8346-45ea09c5563d_del complete
Apr 13 19:16:26 user nova-compute[71692]: INFO nova.compute.manager [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 13 19:16:26 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:16:26 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:16:26 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:16:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:26 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:16:26 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Took 0.82 seconds to deallocate network for instance.
Apr 13 19:16:26 user nova-compute[71692]: DEBUG nova.compute.manager [req-bc2c0632-06d3-4f01-ac55-e8efce51170b req-725b8744-0cea-4fca-951d-80fd16cdf6a8 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-vif-deleted-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:16:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:26 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:27 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:16:27 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:16:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:27 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Deleted allocations for instance 33367b19-4d62-46dc-8346-45ea09c5563d
Apr 13 19:16:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7382ad1f-8458-4ca1-8f60-c9e73c8eea0e tempest-ServerStableDeviceRescueTest-192327838 tempest-ServerStableDeviceRescueTest-192327838-project-member] Lock "33367b19-4d62-46dc-8346-45ea09c5563d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.322s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:27 user nova-compute[71692]: DEBUG nova.compute.manager [req-aaeaa6be-17ed-4706-b73c-f1af9092489e req-bf454a7d-4473-4d19-96be-946e37dc5f09 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:16:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-aaeaa6be-17ed-4706-b73c-f1af9092489e req-bf454a7d-4473-4d19-96be-946e37dc5f09 service nova] Acquiring lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-aaeaa6be-17ed-4706-b73c-f1af9092489e req-bf454a7d-4473-4d19-96be-946e37dc5f09 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-aaeaa6be-17ed-4706-b73c-f1af9092489e req-bf454a7d-4473-4d19-96be-946e37dc5f09 service nova] Lock "33367b19-4d62-46dc-8346-45ea09c5563d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:27 user nova-compute[71692]: DEBUG nova.compute.manager [req-aaeaa6be-17ed-4706-b73c-f1af9092489e req-bf454a7d-4473-4d19-96be-946e37dc5f09 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] No waiting events found dispatching network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:16:27 user nova-compute[71692]: WARNING nova.compute.manager [req-aaeaa6be-17ed-4706-b73c-f1af9092489e req-bf454a7d-4473-4d19-96be-946e37dc5f09 service nova] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Received unexpected event network-vif-plugged-6d1659d8-90f3-45a5-90a0-772abe02c673 for instance with vm_state deleted and task_state None.
Apr 13 19:16:30 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:34 user nova-compute[71692]: INFO nova.compute.manager [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Terminating instance
Apr 13 19:16:34 user nova-compute[71692]: DEBUG nova.compute.manager [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:16:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:35 user nova-compute[71692]: DEBUG nova.compute.manager [req-4067502f-5c46-4547-b15d-73c2bddfe7ae req-9da43719-6938-41a1-a686-804b8281d27a service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Received event network-vif-unplugged-e124e179-0315-423a-b9cf-c232753845ed {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:16:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4067502f-5c46-4547-b15d-73c2bddfe7ae req-9da43719-6938-41a1-a686-804b8281d27a service nova] Acquiring lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4067502f-5c46-4547-b15d-73c2bddfe7ae req-9da43719-6938-41a1-a686-804b8281d27a service nova] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4067502f-5c46-4547-b15d-73c2bddfe7ae req-9da43719-6938-41a1-a686-804b8281d27a service nova] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:35 user nova-compute[71692]: DEBUG nova.compute.manager [req-4067502f-5c46-4547-b15d-73c2bddfe7ae req-9da43719-6938-41a1-a686-804b8281d27a service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] No waiting events found dispatching network-vif-unplugged-e124e179-0315-423a-b9cf-c232753845ed {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:16:35 user nova-compute[71692]: DEBUG nova.compute.manager [req-4067502f-5c46-4547-b15d-73c2bddfe7ae req-9da43719-6938-41a1-a686-804b8281d27a service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Received event network-vif-unplugged-e124e179-0315-423a-b9cf-c232753845ed for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:16:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Instance destroyed successfully.
Apr 13 19:16:35 user nova-compute[71692]: DEBUG nova.objects.instance [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'resources' on Instance uuid ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:16:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:10:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2113721344',display_name='tempest-AttachVolumeNegativeTest-server-2113721344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2113721344',id=24,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKdS7h4tFyxpAMeYLQuh8ih425eVCG7EZMy8h5k1UPuzrtZ/SoBsVJTEzpMJsvBkj1pJCZh3INmXLgWHuWn9olcGY7rfHpFr8uXlLrmR2vq4y76F919hEdaBpypdO4nAA==',key_name='tempest-keypair-1344017995',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:11:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dcc458426af4ea2b4bbcfdf9b4fe041',ramdisk_id='',reservation_id='r-lzpleslk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-513091417',owner_user_name='tempest-AttachVolumeNegativeTest-513091417-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:11:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975d5fe9f1e445f0ba1be8fc71e93ecc',uuid=ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e124e179-0315-423a-b9cf-c232753845ed", "address": "fa:16:3e:1a:cf:e4", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape124e179-03", "ovs_interfaceid": "e124e179-0315-423a-b9cf-c232753845ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:16:35 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converting VIF {"id": "e124e179-0315-423a-b9cf-c232753845ed", "address": "fa:16:3e:1a:cf:e4", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape124e179-03", "ovs_interfaceid": "e124e179-0315-423a-b9cf-c232753845ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:16:35 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:cf:e4,bridge_name='br-int',has_traffic_filtering=True,id=e124e179-0315-423a-b9cf-c232753845ed,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape124e179-03') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:16:35 user nova-compute[71692]: DEBUG os_vif [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:cf:e4,bridge_name='br-int',has_traffic_filtering=True,id=e124e179-0315-423a-b9cf-c232753845ed,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape124e179-03') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:16:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape124e179-03, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:16:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:16:35 user nova-compute[71692]: INFO os_vif [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:cf:e4,bridge_name='br-int',has_traffic_filtering=True,id=e124e179-0315-423a-b9cf-c232753845ed,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape124e179-03')
Apr 13 19:16:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Deleting instance files /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d_del
Apr 13 19:16:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Deletion of /opt/stack/data/nova/instances/ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d_del complete
Apr 13 19:16:35 user nova-compute[71692]: INFO nova.compute.manager [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Took 1.11 seconds to destroy the instance on the hypervisor.
Apr 13 19:16:35 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:16:35 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:16:35 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:16:36 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:16:36 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Took 0.79 seconds to deallocate network for instance.
Apr 13 19:16:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:37 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:16:37 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:16:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:37 user nova-compute[71692]: DEBUG nova.compute.manager [req-2233a819-55aa-40bd-9804-3e123b941b59 req-1a9fbd15-56d3-40c1-9405-6e9c81478112 service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Received event network-vif-plugged-e124e179-0315-423a-b9cf-c232753845ed {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:16:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2233a819-55aa-40bd-9804-3e123b941b59 req-1a9fbd15-56d3-40c1-9405-6e9c81478112 service nova] Acquiring lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2233a819-55aa-40bd-9804-3e123b941b59 req-1a9fbd15-56d3-40c1-9405-6e9c81478112 service nova] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2233a819-55aa-40bd-9804-3e123b941b59 req-1a9fbd15-56d3-40c1-9405-6e9c81478112 service nova] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:37 user nova-compute[71692]: DEBUG nova.compute.manager [req-2233a819-55aa-40bd-9804-3e123b941b59 req-1a9fbd15-56d3-40c1-9405-6e9c81478112 service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] No waiting events found dispatching network-vif-plugged-e124e179-0315-423a-b9cf-c232753845ed {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:16:37 user nova-compute[71692]: WARNING nova.compute.manager [req-2233a819-55aa-40bd-9804-3e123b941b59 req-1a9fbd15-56d3-40c1-9405-6e9c81478112 service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Received unexpected event network-vif-plugged-e124e179-0315-423a-b9cf-c232753845ed for instance with vm_state deleted and task_state None.
Apr 13 19:16:37 user nova-compute[71692]: DEBUG nova.compute.manager [req-2233a819-55aa-40bd-9804-3e123b941b59 req-1a9fbd15-56d3-40c1-9405-6e9c81478112 service nova] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Received event network-vif-deleted-e124e179-0315-423a-b9cf-c232753845ed {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:16:37 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Deleted allocations for instance ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d
Apr 13 19:16:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-93e3ceec-6192-4f16-9b9c-65f85d44323a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.508s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:39 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:16:40 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:16:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:40 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413385.9456637, 33367b19-4d62-46dc-8346-45ea09c5563d => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:16:40 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] VM Stopped (Lifecycle Event)
Apr 13 19:16:40 user nova-compute[71692]: DEBUG nova.compute.manager [None req-4422bc45-a807-4d30-8af8-532d2d85eeb2 None None] [instance: 33367b19-4d62-46dc-8346-45ea09c5563d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:16:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:42 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:16:42 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:16:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "166341f7-a5fa-4034-8281-6aed0be1bd5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:42 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:16:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:42 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:16:42 user nova-compute[71692]: INFO nova.compute.claims [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Claim successful on node user
Apr 13 19:16:43 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:16:43 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:16:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG nova.policy [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '789fdd98ede74e6783b667178c2689fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024f13d8c179482791ed1545b6b2efd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:16:43 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Creating image(s)
Apr 13 19:16:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "/opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "/opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "/opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.184s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk 1073741824" returned: 0 in 0.047s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Checking if we can resize image /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:43 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Successfully created port: 3e4a73da-8c31-4a03-a16a-69ff3f84b550 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:16:44 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:44 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Cannot resize image /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:16:44 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lazy-loading 'migration_context' on Instance uuid 166341f7-a5fa-4034-8281-6aed0be1bd5a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:16:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:16:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Ensure instance console log exists: /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:16:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:44 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:16:44 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:16:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:16:44 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Successfully updated port: 3e4a73da-8c31-4a03-a16a-69ff3f84b550 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:16:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "refresh_cache-166341f7-a5fa-4034-8281-6aed0be1bd5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:16:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquired lock "refresh_cache-166341f7-a5fa-4034-8281-6aed0be1bd5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:16:44 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.compute.manager [req-0d11d502-919d-4356-a363-4eff14d43e87 req-7052eef1-c061-4861-8715-41daac1bc670 service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Received event network-changed-3e4a73da-8c31-4a03-a16a-69ff3f84b550 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.compute.manager [req-0d11d502-919d-4356-a363-4eff14d43e87 req-7052eef1-c061-4861-8715-41daac1bc670 service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Refreshing instance network info cache due to event network-changed-3e4a73da-8c31-4a03-a16a-69ff3f84b550. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d11d502-919d-4356-a363-4eff14d43e87 req-7052eef1-c061-4861-8715-41daac1bc670 service nova] Acquiring lock "refresh_cache-166341f7-a5fa-4034-8281-6aed0be1bd5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Updating instance_info_cache with network_info: [{"id": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "address": "fa:16:3e:c6:17:d6", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4a73da-8c", "ovs_interfaceid": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Releasing lock "refresh_cache-166341f7-a5fa-4034-8281-6aed0be1bd5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Instance network_info: |[{"id": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "address": "fa:16:3e:c6:17:d6", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4a73da-8c", "ovs_interfaceid": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d11d502-919d-4356-a363-4eff14d43e87 req-7052eef1-c061-4861-8715-41daac1bc670 service nova] Acquired lock "refresh_cache-166341f7-a5fa-4034-8281-6aed0be1bd5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.network.neutron [req-0d11d502-919d-4356-a363-4eff14d43e87 req-7052eef1-c061-4861-8715-41daac1bc670 service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Refreshing network info cache for port 3e4a73da-8c31-4a03-a16a-69ff3f84b550 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Start _get_guest_xml network_info=[{"id": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "address": "fa:16:3e:c6:17:d6", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4a73da-8c", "ovs_interfaceid": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:16:45 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:16:45 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-430407348',display_name='tempest-VolumesSnapshotTestJSON-instance-430407348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-430407348',id=31,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='024f13d8c179482791ed1545b6b2efd8',ramdisk_id='',reservation_id='r-c66vqa7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-613917248',owner_user_name='tempest-VolumesSnapshotTestJSON-613917248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:16:43Z,user_data=None,user_id='789fdd98ede74e6783b667178c2689fb',uuid=166341f7-a5fa-4034-8281-6aed0be1bd5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "address": "fa:16:3e:c6:17:d6", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4a73da-8c", "ovs_interfaceid": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Converting VIF {"id": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "address": "fa:16:3e:c6:17:d6", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4a73da-8c", "ovs_interfaceid": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:17:d6,bridge_name='br-int',has_traffic_filtering=True,id=3e4a73da-8c31-4a03-a16a-69ff3f84b550,network=Network(0e855c73-cf7d-4c09-9fb5-3a4a7903b519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4a73da-8c') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lazy-loading 'pci_devices' on Instance uuid 166341f7-a5fa-4034-8281-6aed0be1bd5a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:16:45 user nova-compute[71692]:   <uuid>166341f7-a5fa-4034-8281-6aed0be1bd5a</uuid>
Apr 13 19:16:45 user nova-compute[71692]:   <name>instance-0000001f</name>
Apr 13 19:16:45 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:16:45 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:16:45 user nova-compute[71692]:   <metadata>
Apr 13 19:16:45 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:16:45 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:16:45 user nova-compute[71692]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-430407348</nova:name>
Apr 13 19:16:45 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:16:45</nova:creationTime>
Apr 13 19:16:45 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:16:45 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:16:45 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:16:45 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:16:45 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:16:45 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:16:45 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:16:45 user nova-compute[71692]:       <nova:owner>
Apr 13 19:16:45 user nova-compute[71692]:         <nova:user uuid="789fdd98ede74e6783b667178c2689fb">tempest-VolumesSnapshotTestJSON-613917248-project-member</nova:user>
Apr 13 19:16:45 user nova-compute[71692]:         <nova:project uuid="024f13d8c179482791ed1545b6b2efd8">tempest-VolumesSnapshotTestJSON-613917248</nova:project>
Apr 13 19:16:45 user nova-compute[71692]:       </nova:owner>
Apr 13 19:16:45 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:16:45 user nova-compute[71692]:       <nova:ports>
Apr 13 19:16:45 user nova-compute[71692]:         <nova:port uuid="3e4a73da-8c31-4a03-a16a-69ff3f84b550">
Apr 13 19:16:45 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.2" ipVersion="4"/>
Apr 13 19:16:45 user nova-compute[71692]:         </nova:port>
Apr 13 19:16:45 user nova-compute[71692]:       </nova:ports>
Apr 13 19:16:45 user nova-compute[71692]:     </nova:instance>
Apr 13 19:16:45 user nova-compute[71692]:   </metadata>
Apr 13 19:16:45 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:16:45 user nova-compute[71692]:     <system>
Apr 13 19:16:45 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:16:45 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:16:45 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:16:45 user nova-compute[71692]:       <entry name="serial">166341f7-a5fa-4034-8281-6aed0be1bd5a</entry>
Apr 13 19:16:45 user nova-compute[71692]:       <entry name="uuid">166341f7-a5fa-4034-8281-6aed0be1bd5a</entry>
Apr 13 19:16:45 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:16:45 user nova-compute[71692]:     </system>
Apr 13 19:16:45 user nova-compute[71692]:   </sysinfo>
Apr 13 19:16:45 user nova-compute[71692]:   <os>
Apr 13 19:16:45 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:16:45 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:16:45 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:16:45 user nova-compute[71692]:   </os>
Apr 13 19:16:45 user nova-compute[71692]:   <features>
Apr 13 19:16:45 user nova-compute[71692]:     <acpi/>
Apr 13 19:16:45 user nova-compute[71692]:     <apic/>
Apr 13 19:16:45 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:16:45 user nova-compute[71692]:   </features>
Apr 13 19:16:45 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:16:45 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:16:45 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:16:45 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:16:45 user nova-compute[71692]:   </clock>
Apr 13 19:16:45 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:16:45 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:16:45 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:16:45 user nova-compute[71692]:   </cpu>
Apr 13 19:16:45 user nova-compute[71692]:   <devices>
Apr 13 19:16:45 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:16:45 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:16:45 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk"/>
Apr 13 19:16:45 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:16:45 user nova-compute[71692]:     </disk>
Apr 13 19:16:45 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:16:45 user nova-compute[71692]:       <mac address="fa:16:3e:c6:17:d6"/>
Apr 13 19:16:45 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:16:45 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:16:45 user nova-compute[71692]:       <target dev="tap3e4a73da-8c"/>
Apr 13 19:16:45 user nova-compute[71692]:     </interface>
Apr 13 19:16:45 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:16:45 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/console.log" append="off"/>
Apr 13 19:16:45 user nova-compute[71692]:     </serial>
Apr 13 19:16:45 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:16:45 user nova-compute[71692]:     <video>
Apr 13 19:16:45 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:16:45 user nova-compute[71692]:     </video>
Apr 13 19:16:45 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:16:45 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:16:45 user nova-compute[71692]:     </rng>
Apr 13 19:16:45 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:16:45 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:16:45 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:16:45 user nova-compute[71692]:     </memballoon>
Apr 13 19:16:45 user nova-compute[71692]:   </devices>
Apr 13 19:16:45 user nova-compute[71692]: </domain>
Apr 13 19:16:45 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-430407348',display_name='tempest-VolumesSnapshotTestJSON-instance-430407348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-430407348',id=31,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='024f13d8c179482791ed1545b6b2efd8',ramdisk_id='',reservation_id='r-c66vqa7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-613917248',owner_user_name='tempest-VolumesSnapshotTestJSON-613917248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:16:43Z,user_data=None,user_id='789fdd98ede74e6783b667178c2689fb',uuid=166341f7-a5fa-4034-8281-6aed0be1bd5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "address": "fa:16:3e:c6:17:d6", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4a73da-8c", "ovs_interfaceid": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Converting VIF {"id": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "address": "fa:16:3e:c6:17:d6", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4a73da-8c", "ovs_interfaceid": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:17:d6,bridge_name='br-int',has_traffic_filtering=True,id=3e4a73da-8c31-4a03-a16a-69ff3f84b550,network=Network(0e855c73-cf7d-4c09-9fb5-3a4a7903b519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4a73da-8c') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG os_vif [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:17:d6,bridge_name='br-int',has_traffic_filtering=True,id=3e4a73da-8c31-4a03-a16a-69ff3f84b550,network=Network(0e855c73-cf7d-4c09-9fb5-3a4a7903b519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4a73da-8c') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e4a73da-8c, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e4a73da-8c, col_values=(('external_ids', {'iface-id': '3e4a73da-8c31-4a03-a16a-69ff3f84b550', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:17:d6', 'vm-uuid': '166341f7-a5fa-4034-8281-6aed0be1bd5a'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:45 user nova-compute[71692]: INFO os_vif [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:17:d6,bridge_name='br-int',has_traffic_filtering=True,id=3e4a73da-8c31-4a03-a16a-69ff3f84b550,network=Network(0e855c73-cf7d-4c09-9fb5-3a4a7903b519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4a73da-8c')
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] No VIF found with MAC fa:16:3e:c6:17:d6, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.network.neutron [req-0d11d502-919d-4356-a363-4eff14d43e87 req-7052eef1-c061-4861-8715-41daac1bc670 service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Updated VIF entry in instance network info cache for port 3e4a73da-8c31-4a03-a16a-69ff3f84b550. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG nova.network.neutron [req-0d11d502-919d-4356-a363-4eff14d43e87 req-7052eef1-c061-4861-8715-41daac1bc670 service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Updating instance_info_cache with network_info: [{"id": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "address": "fa:16:3e:c6:17:d6", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4a73da-8c", "ovs_interfaceid": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:16:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0d11d502-919d-4356-a363-4eff14d43e87 req-7052eef1-c061-4861-8715-41daac1bc670 service nova] Releasing lock "refresh_cache-166341f7-a5fa-4034-8281-6aed0be1bd5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:16:46 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:16:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:46 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:16:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "a9f3d080-a163-4897-9187-2687cae49694" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:46 user nova-compute[71692]: DEBUG nova.compute.manager [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Going to confirm migration 2 {{(pid=71692) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 13 19:16:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquired lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG nova.network.neutron [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG nova.objects.instance [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'info_cache' on Instance uuid a9f3d080-a163-4897-9187-2687cae49694 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-ba333d86-f48b-4cf7-a812-3488771ca614 req-adb876ae-fa19-4073-8fb7-17f50d1db271 service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Received event network-vif-plugged-3e4a73da-8c31-4a03-a16a-69ff3f84b550 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ba333d86-f48b-4cf7-a812-3488771ca614 req-adb876ae-fa19-4073-8fb7-17f50d1db271 service nova] Acquiring lock "166341f7-a5fa-4034-8281-6aed0be1bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ba333d86-f48b-4cf7-a812-3488771ca614 req-adb876ae-fa19-4073-8fb7-17f50d1db271 service nova] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ba333d86-f48b-4cf7-a812-3488771ca614 req-adb876ae-fa19-4073-8fb7-17f50d1db271 service nova] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-ba333d86-f48b-4cf7-a812-3488771ca614 req-adb876ae-fa19-4073-8fb7-17f50d1db271 service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] No waiting events found dispatching network-vif-plugged-3e4a73da-8c31-4a03-a16a-69ff3f84b550 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:16:47 user nova-compute[71692]: WARNING nova.compute.manager [req-ba333d86-f48b-4cf7-a812-3488771ca614 req-adb876ae-fa19-4073-8fb7-17f50d1db271 service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Received unexpected event network-vif-plugged-3e4a73da-8c31-4a03-a16a-69ff3f84b550 for instance with vm_state building and task_state spawning.
Apr 13 19:16:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG nova.network.neutron [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Updating instance_info_cache with network_info: [{"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Releasing lock "refresh_cache-a9f3d080-a163-4897-9187-2687cae49694" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG nova.objects.instance [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'migration_context' on Instance uuid a9f3d080-a163-4897-9187-2687cae49694 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.126s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.438s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:48 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Deleted allocation for migration 9a0976be-7ccb-41ea-a57f-8d3dcd983361
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-06deb564-f4d9-41e8-9c67-af8d4c757b66 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "a9f3d080-a163-4897-9187-2687cae49694" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.490s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.manager [req-87a99ab3-ee53-43ec-a8f4-3bc06db5faa0 req-e6d49d01-c32b-4917-aad8-ef7d898a1b8b service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Received event network-vif-plugged-3e4a73da-8c31-4a03-a16a-69ff3f84b550 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-87a99ab3-ee53-43ec-a8f4-3bc06db5faa0 req-e6d49d01-c32b-4917-aad8-ef7d898a1b8b service nova] Acquiring lock "166341f7-a5fa-4034-8281-6aed0be1bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-87a99ab3-ee53-43ec-a8f4-3bc06db5faa0 req-e6d49d01-c32b-4917-aad8-ef7d898a1b8b service nova] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-87a99ab3-ee53-43ec-a8f4-3bc06db5faa0 req-e6d49d01-c32b-4917-aad8-ef7d898a1b8b service nova] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.manager [req-87a99ab3-ee53-43ec-a8f4-3bc06db5faa0 req-e6d49d01-c32b-4917-aad8-ef7d898a1b8b service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] No waiting events found dispatching network-vif-plugged-3e4a73da-8c31-4a03-a16a-69ff3f84b550 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:16:49 user nova-compute[71692]: WARNING nova.compute.manager [req-87a99ab3-ee53-43ec-a8f4-3bc06db5faa0 req-e6d49d01-c32b-4917-aad8-ef7d898a1b8b service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Received unexpected event network-vif-plugged-3e4a73da-8c31-4a03-a16a-69ff3f84b550 for instance with vm_state building and task_state spawning.
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413409.1892715, 166341f7-a5fa-4034-8281-6aed0be1bd5a => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:16:49 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] VM Resumed (Lifecycle Event)
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:16:49 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Instance spawned successfully.
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:16:49 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413409.1906416, 166341f7-a5fa-4034-8281-6aed0be1bd5a => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:16:49 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] VM Started (Lifecycle Event)
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:49 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:16:49 user nova-compute[71692]: INFO nova.compute.manager [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Took 5.92 seconds to spawn the instance on the hypervisor.
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:16:49 user nova-compute[71692]: INFO nova.compute.manager [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Took 6.55 seconds to build instance.
Apr 13 19:16:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e97ed505-b5f3-4412-a408-662b01aa15a5 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.639s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:49 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:16:49 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8096MB free_disk=26.100055694580078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 59d7b86a-c723-4255-827e-2f6a641239df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 579c83e7-7976-47f4-9f25-a194e39966ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 01bd39f7-7d27-48cf-982e-181aadc060ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 080204b2-fd4d-4224-b391-a27036d058ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance a9f3d080-a163-4897-9187-2687cae49694 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 166341f7-a5fa-4034-8281-6aed0be1bd5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:16:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:16:50 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:16:50 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:16:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:16:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:50 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413395.7886546, ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:16:50 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] VM Stopped (Lifecycle Event)
Apr 13 19:16:50 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8206d109-36bd-4c85-839d-e18d5699ca1b None None] [instance: ce77b7e7-75d4-4c22-be9e-4a9b81bfdd0d] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:16:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:52 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:16:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:16:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:16:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:16:52 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:16:52 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Updating instance_info_cache with network_info: [{"id": "ab959649-556a-479c-9e13-ec36fb9ebb66", "address": "fa:16:3e:4b:6d:5f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab959649-55", "ovs_interfaceid": "ab959649-556a-479c-9e13-ec36fb9ebb66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:16:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:16:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:16:52 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:16:52 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:16:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG nova.objects.instance [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'flavor' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:16:56 user nova-compute[71692]: INFO nova.compute.manager [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Attaching volume 73f562c0-29d2-40b3-ab57-aec970aee446 to /dev/vdb
Apr 13 19:16:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG os_brick.utils [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2df20aa-d643-4216-b9b9-7c1f528fa819]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ced20cd-3491-408c-8c18-3c49af55e3bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dfe30d-c27e-450e-b3b1-f564ef0d68d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efd8a23-e29f-4946-a713-e0c533e2f4a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:16:56 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:16:56 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad0a460-e63a-4c9a-9db3-10cbe6ea2628]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG os_brick.utils [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:16:56 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Updating existing volume attachment record: 988c73a4-0fc6-4d29-a92c-d652707544a1 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:17:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEWaJFZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:17:01 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:17:01 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:17:01 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd7293d-4302-4782-97ba-dcf2b35180c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:17:01 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ec8bf2-a773-4669-968b-ea38e18db15d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446] added
Apr 13 19:17:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc0fe07-af9f-43b4-9eb3-de02b88ddbd1]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[687eca7b-8941-4625-96f3-b7f58e9345ac]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kEWaJFZe {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kEWaJFZe" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[391f022f-910e-461f-b321-2594cc018c65]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kEWaJFZe'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8b592c-056a-42cd-8b4f-54350a5e3e4f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3f07f2-b1b1-40db-a3f8-6912be05e515]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:17:01 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:17:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:17:01 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:17:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a95b6d-21ee-41c8-984c-c92e6c4f4b3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446, portal: 172.16.0.220,3260]
Apr 13 19:17:01 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446, portal: 172.16.0.220,3260] successful.
Apr 13 19:17:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5cecab-6056-4260-844e-16c3d0e49fbb]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6becb443-6b87-416c-9e36-2df50b9a2b59]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:17:01 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:17:01 user nova-compute[71692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 (non-flash)
Apr 13 19:17:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:17:01 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:17:01 user nova-compute[71692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 (non-flash)
Apr 13 19:17:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.035s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4914061c-f830-4898-95eb-8f2035b22a04]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:17:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEWaJFZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:17:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:17:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23635383366323163', 'path': '/dev/sdc'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:17:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635383366323163', 'path': '/dev/sdc'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:17:02 user nova-compute[71692]: DEBUG nova.objects.instance [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'flavor' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:17:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:17:02 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:17:02 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:17:02 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:17:02 user nova-compute[71692]:   <serial>73f562c0-29d2-40b3-ab57-aec970aee446</serial>
Apr 13 19:17:02 user nova-compute[71692]: </disk>
Apr 13 19:17:02 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:17:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:17:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:17:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] No VIF found with MAC fa:16:3e:8e:c2:1f, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:17:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8f74d936-da10-49a6-80a1-7189a43341cc tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.737s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:17:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:17:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:17:04 user nova-compute[71692]: INFO nova.compute.manager [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Detaching volume 73f562c0-29d2-40b3-ab57-aec970aee446
Apr 13 19:17:04 user nova-compute[71692]: INFO nova.virt.block_device [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Attempting to driver detach volume 73f562c0-29d2-40b3-ab57-aec970aee446 from mountpoint /dev/vdb
Apr 13 19:17:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Attempting to detach device vdb from instance 080204b2-fd4d-4224-b391-a27036d058ac from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:17:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:17:04 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:17:04 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:17:04 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:17:04 user nova-compute[71692]:   <serial>73f562c0-29d2-40b3-ab57-aec970aee446</serial>
Apr 13 19:17:04 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:17:04 user nova-compute[71692]: </disk>
Apr 13 19:17:04 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:17:04 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Successfully detached device vdb from instance 080204b2-fd4d-4224-b391-a27036d058ac from the persistent domain config.
Apr 13 19:17:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 080204b2-fd4d-4224-b391-a27036d058ac from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:17:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:17:04 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:17:04 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:17:04 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:17:04 user nova-compute[71692]:   <serial>73f562c0-29d2-40b3-ab57-aec970aee446</serial>
Apr 13 19:17:04 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:17:04 user nova-compute[71692]: </disk>
Apr 13 19:17:04 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681413425.202416, 080204b2-fd4d-4224-b391-a27036d058ac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:17:05 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Successfully detached device vdb from instance 080204b2-fd4d-4224-b391-a27036d058ac from the live domain config.
Apr 13 19:17:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kEWaJFZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:17:05 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac3a4f8-163e-4f7a-a2cc-72dd0a1169b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:17:05 user nova-compute[71692]: No targets found.
Apr 13 19:17:05 user nova-compute[71692]: iSNS:
Apr 13 19:17:05 user nova-compute[71692]: No targets found.
Apr 13 19:17:05 user nova-compute[71692]: STATIC:
Apr 13 19:17:05 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959
Apr 13 19:17:05 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:17:05 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:17:05 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446
Apr 13 19:17:05 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:17:05 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:17:05 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2
Apr 13 19:17:05 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:17:05 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:17:05 user nova-compute[71692]: FIRMWARE:
Apr 13 19:17:05 user nova-compute[71692]: No targets found.
Apr 13 19:17:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:17:05 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:17:05 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe6b40e-b927-4a27-a0de-56b364976b12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51e421a-e164-4ea5-a548-fc8c6248f000]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:17:05 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:17:05 user nova-compute[71692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 (non-flash)
Apr 13 19:17:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:17:05 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:17:05 user nova-compute[71692]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 (non-flash)
Apr 13 19:17:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febd8b5d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446'): ({'sdc'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Removing single pathed devices sdc {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62bf623-ccc8-4b43-929c-f052b36b012b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caf3a2b-3643-480f-8e7d-2c1a720c9cfb]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Flushing IO for device /dev/sdc {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7ff5d8-f9a6-428b-b8db-48cb6945f8e4]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2200b36c-cb69-4497-96f4-a5b77a34fe67]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[268468c2-ff53-463a-ac0e-ae6714527b72]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a56f17-128a-4d8a-8b0d-0ac747851a3e]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446, portal: 172.16.0.220,3260]
Apr 13 19:17:05 user nova-compute[71692]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446, portal: 172.16.0.220,3260] successful.
Apr 13 19:17:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73f562c0-29d2-40b3-ab57-aec970aee446 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6456c28-d5b0-4fdf-b0f8-54b2fcc0724b]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] <== disconnect_volume: return (305ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:17:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:17:06 user nova-compute[71692]: DEBUG nova.objects.instance [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'flavor' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:17:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d157985e-38ce-426f-8051-ad14f7d0fc27 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.605s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:17:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:17:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "620bc9c9-26a0-461f-8771-418b3e9aea79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:17:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:17:28 user nova-compute[71692]: DEBUG nova.compute.manager [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:17:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:17:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:17:29 user nova-compute[71692]: INFO nova.compute.claims [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Claim successful on node user
Apr 13 19:17:29 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG nova.network.neutron [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:17:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:17:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:17:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Creating image(s)
Apr 13 19:17:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "/opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "/opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "/opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG nova.policy [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '975d5fe9f1e445f0ba1be8fc71e93ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc458426af4ea2b4bbcfdf9b4fe041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk 1073741824" returned: 0 in 0.049s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:17:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:30 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Checking if we can resize image /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:17:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:30 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Cannot resize image /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:17:30 user nova-compute[71692]: DEBUG nova.objects.instance [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'migration_context' on Instance uuid 620bc9c9-26a0-461f-8771-418b3e9aea79 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:17:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:17:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Ensure instance console log exists: /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:17:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:17:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:17:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:17:30 user nova-compute[71692]: DEBUG nova.network.neutron [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Successfully created port: 96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:17:30 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.network.neutron [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Successfully updated port: 96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "refresh_cache-620bc9c9-26a0-461f-8771-418b3e9aea79" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquired lock "refresh_cache-620bc9c9-26a0-461f-8771-418b3e9aea79" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.network.neutron [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.network.neutron [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-8535ee7c-422f-415d-8b6f-d5618d9ff3b2 req-78144bd5-a55b-4ff1-8034-28235761e144 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received event network-changed-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-8535ee7c-422f-415d-8b6f-d5618d9ff3b2 req-78144bd5-a55b-4ff1-8034-28235761e144 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Refreshing instance network info cache due to event network-changed-96f25cc6-1d0b-467a-be3e-a312cd09fbdf. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8535ee7c-422f-415d-8b6f-d5618d9ff3b2 req-78144bd5-a55b-4ff1-8034-28235761e144 service nova] Acquiring lock "refresh_cache-620bc9c9-26a0-461f-8771-418b3e9aea79" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.network.neutron [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Updating instance_info_cache with network_info: [{"id": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "address": "fa:16:3e:a6:27:19", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f25cc6-1d", "ovs_interfaceid": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Releasing lock "refresh_cache-620bc9c9-26a0-461f-8771-418b3e9aea79" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.compute.manager [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Instance network_info: |[{"id": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "address": "fa:16:3e:a6:27:19", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f25cc6-1d", "ovs_interfaceid": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8535ee7c-422f-415d-8b6f-d5618d9ff3b2 req-78144bd5-a55b-4ff1-8034-28235761e144 service nova] Acquired lock "refresh_cache-620bc9c9-26a0-461f-8771-418b3e9aea79" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.network.neutron [req-8535ee7c-422f-415d-8b6f-d5618d9ff3b2 req-78144bd5-a55b-4ff1-8034-28235761e144 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Refreshing network info cache for port 96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Start _get_guest_xml network_info=[{"id": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "address": "fa:16:3e:a6:27:19", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f25cc6-1d", "ovs_interfaceid": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:17:31 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:17:31 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-451260104',display_name='tempest-AttachVolumeNegativeTest-server-451260104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-451260104',id=32,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqWTeW94mC6Qab592n4roQSgR0ReQD5GgNdKv6uLCTG70d8Ti2XZh02FAhLCrLlr4yJF7KPa+B4KdHaRg688OqQ3OKYgcRxDDHxlwTkNdr/Fm6F9nxu0scVEuiXFVXE8w==',key_name='tempest-keypair-737326002',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dcc458426af4ea2b4bbcfdf9b4fe041',ramdisk_id='',reservation_id='r-4vnemima',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-513091417',owner_user_name='tempest-AttachVolumeNegativeTest-513091417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:17:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975d5fe9f1e445f0ba1be8fc71e93ecc',uuid=620bc9c9-26a0-461f-8771-418b3e9aea79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "address": "fa:16:3e:a6:27:19", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f25cc6-1d", "ovs_interfaceid": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converting VIF {"id": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "address": "fa:16:3e:a6:27:19", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f25cc6-1d", "ovs_interfaceid": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:27:19,bridge_name='br-int',has_traffic_filtering=True,id=96f25cc6-1d0b-467a-be3e-a312cd09fbdf,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f25cc6-1d') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.objects.instance [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'pci_devices' on Instance uuid 620bc9c9-26a0-461f-8771-418b3e9aea79 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:17:31 user nova-compute[71692]:   <uuid>620bc9c9-26a0-461f-8771-418b3e9aea79</uuid>
Apr 13 19:17:31 user nova-compute[71692]:   <name>instance-00000020</name>
Apr 13 19:17:31 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:17:31 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:17:31 user nova-compute[71692]:   <metadata>
Apr 13 19:17:31 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:17:31 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:17:31 user nova-compute[71692]:       <nova:name>tempest-AttachVolumeNegativeTest-server-451260104</nova:name>
Apr 13 19:17:31 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:17:31</nova:creationTime>
Apr 13 19:17:31 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:17:31 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:17:31 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:17:31 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:17:31 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:17:31 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:17:31 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:17:31 user nova-compute[71692]:       <nova:owner>
Apr 13 19:17:31 user nova-compute[71692]:         <nova:user uuid="975d5fe9f1e445f0ba1be8fc71e93ecc">tempest-AttachVolumeNegativeTest-513091417-project-member</nova:user>
Apr 13 19:17:31 user nova-compute[71692]:         <nova:project uuid="0dcc458426af4ea2b4bbcfdf9b4fe041">tempest-AttachVolumeNegativeTest-513091417</nova:project>
Apr 13 19:17:31 user nova-compute[71692]:       </nova:owner>
Apr 13 19:17:31 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:17:31 user nova-compute[71692]:       <nova:ports>
Apr 13 19:17:31 user nova-compute[71692]:         <nova:port uuid="96f25cc6-1d0b-467a-be3e-a312cd09fbdf">
Apr 13 19:17:31 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 19:17:31 user nova-compute[71692]:         </nova:port>
Apr 13 19:17:31 user nova-compute[71692]:       </nova:ports>
Apr 13 19:17:31 user nova-compute[71692]:     </nova:instance>
Apr 13 19:17:31 user nova-compute[71692]:   </metadata>
Apr 13 19:17:31 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:17:31 user nova-compute[71692]:     <system>
Apr 13 19:17:31 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:17:31 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:17:31 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:17:31 user nova-compute[71692]:       <entry name="serial">620bc9c9-26a0-461f-8771-418b3e9aea79</entry>
Apr 13 19:17:31 user nova-compute[71692]:       <entry name="uuid">620bc9c9-26a0-461f-8771-418b3e9aea79</entry>
Apr 13 19:17:31 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:17:31 user nova-compute[71692]:     </system>
Apr 13 19:17:31 user nova-compute[71692]:   </sysinfo>
Apr 13 19:17:31 user nova-compute[71692]:   <os>
Apr 13 19:17:31 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:17:31 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:17:31 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:17:31 user nova-compute[71692]:   </os>
Apr 13 19:17:31 user nova-compute[71692]:   <features>
Apr 13 19:17:31 user nova-compute[71692]:     <acpi/>
Apr 13 19:17:31 user nova-compute[71692]:     <apic/>
Apr 13 19:17:31 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:17:31 user nova-compute[71692]:   </features>
Apr 13 19:17:31 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:17:31 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:17:31 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:17:31 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:17:31 user nova-compute[71692]:   </clock>
Apr 13 19:17:31 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:17:31 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:17:31 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:17:31 user nova-compute[71692]:   </cpu>
Apr 13 19:17:31 user nova-compute[71692]:   <devices>
Apr 13 19:17:31 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:17:31 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:17:31 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk"/>
Apr 13 19:17:31 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:17:31 user nova-compute[71692]:     </disk>
Apr 13 19:17:31 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:17:31 user nova-compute[71692]:       <mac address="fa:16:3e:a6:27:19"/>
Apr 13 19:17:31 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:17:31 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:17:31 user nova-compute[71692]:       <target dev="tap96f25cc6-1d"/>
Apr 13 19:17:31 user nova-compute[71692]:     </interface>
Apr 13 19:17:31 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:17:31 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/console.log" append="off"/>
Apr 13 19:17:31 user nova-compute[71692]:     </serial>
Apr 13 19:17:31 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:17:31 user nova-compute[71692]:     <video>
Apr 13 19:17:31 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:17:31 user nova-compute[71692]:     </video>
Apr 13 19:17:31 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:17:31 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:17:31 user nova-compute[71692]:     </rng>
Apr 13 19:17:31 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:17:31 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:17:31 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:17:31 user nova-compute[71692]:     </memballoon>
Apr 13 19:17:31 user nova-compute[71692]:   </devices>
Apr 13 19:17:31 user nova-compute[71692]: </domain>
Apr 13 19:17:31 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-451260104',display_name='tempest-AttachVolumeNegativeTest-server-451260104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-451260104',id=32,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqWTeW94mC6Qab592n4roQSgR0ReQD5GgNdKv6uLCTG70d8Ti2XZh02FAhLCrLlr4yJF7KPa+B4KdHaRg688OqQ3OKYgcRxDDHxlwTkNdr/Fm6F9nxu0scVEuiXFVXE8w==',key_name='tempest-keypair-737326002',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dcc458426af4ea2b4bbcfdf9b4fe041',ramdisk_id='',reservation_id='r-4vnemima',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-513091417',owner_user_name='tempest-AttachVolumeNegativeTest-513091417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:17:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975d5fe9f1e445f0ba1be8fc71e93ecc',uuid=620bc9c9-26a0-461f-8771-418b3e9aea79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "address": "fa:16:3e:a6:27:19", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f25cc6-1d", "ovs_interfaceid": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converting VIF {"id": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "address": "fa:16:3e:a6:27:19", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f25cc6-1d", "ovs_interfaceid": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:27:19,bridge_name='br-int',has_traffic_filtering=True,id=96f25cc6-1d0b-467a-be3e-a312cd09fbdf,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f25cc6-1d') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG os_vif [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:27:19,bridge_name='br-int',has_traffic_filtering=True,id=96f25cc6-1d0b-467a-be3e-a312cd09fbdf,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f25cc6-1d') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96f25cc6-1d, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:17:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96f25cc6-1d, col_values=(('external_ids', {'iface-id': '96f25cc6-1d0b-467a-be3e-a312cd09fbdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:27:19', 'vm-uuid': '620bc9c9-26a0-461f-8771-418b3e9aea79'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:17:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:17:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:32 user nova-compute[71692]: INFO os_vif [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:27:19,bridge_name='br-int',has_traffic_filtering=True,id=96f25cc6-1d0b-467a-be3e-a312cd09fbdf,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f25cc6-1d')
Apr 13 19:17:32 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:17:32 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] No VIF found with MAC fa:16:3e:a6:27:19, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:17:32 user nova-compute[71692]: DEBUG nova.network.neutron [req-8535ee7c-422f-415d-8b6f-d5618d9ff3b2 req-78144bd5-a55b-4ff1-8034-28235761e144 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Updated VIF entry in instance network info cache for port 96f25cc6-1d0b-467a-be3e-a312cd09fbdf. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:17:32 user nova-compute[71692]: DEBUG nova.network.neutron [req-8535ee7c-422f-415d-8b6f-d5618d9ff3b2 req-78144bd5-a55b-4ff1-8034-28235761e144 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Updating instance_info_cache with network_info: [{"id": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "address": "fa:16:3e:a6:27:19", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f25cc6-1d", "ovs_interfaceid": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:17:32 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8535ee7c-422f-415d-8b6f-d5618d9ff3b2 req-78144bd5-a55b-4ff1-8034-28235761e144 service nova] Releasing lock "refresh_cache-620bc9c9-26a0-461f-8771-418b3e9aea79" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:17:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:33 user nova-compute[71692]: DEBUG nova.compute.manager [req-f64e7dc5-507b-41c6-85b8-5274e6de9071 req-151753ea-beb6-44c8-81dc-fec6234b22f8 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received event network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:17:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f64e7dc5-507b-41c6-85b8-5274e6de9071 req-151753ea-beb6-44c8-81dc-fec6234b22f8 service nova] Acquiring lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:17:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f64e7dc5-507b-41c6-85b8-5274e6de9071 req-151753ea-beb6-44c8-81dc-fec6234b22f8 service nova] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:17:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f64e7dc5-507b-41c6-85b8-5274e6de9071 req-151753ea-beb6-44c8-81dc-fec6234b22f8 service nova] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:17:33 user nova-compute[71692]: DEBUG nova.compute.manager [req-f64e7dc5-507b-41c6-85b8-5274e6de9071 req-151753ea-beb6-44c8-81dc-fec6234b22f8 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] No waiting events found dispatching network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:17:33 user nova-compute[71692]: WARNING nova.compute.manager [req-f64e7dc5-507b-41c6-85b8-5274e6de9071 req-151753ea-beb6-44c8-81dc-fec6234b22f8 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received unexpected event network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance with vm_state building and task_state spawning.
Apr 13 19:17:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:35 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413455.878888, 620bc9c9-26a0-461f-8771-418b3e9aea79 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:17:35 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] VM Resumed (Lifecycle Event)
Apr 13 19:17:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:17:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:17:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Instance spawned successfully.
Apr 13 19:17:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:17:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:17:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:17:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:17:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:17:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:17:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:17:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:17:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:17:35 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:17:35 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413455.8810897, 620bc9c9-26a0-461f-8771-418b3e9aea79 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:17:35 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] VM Started (Lifecycle Event)
Apr 13 19:17:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:17:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:17:35 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:17:35 user nova-compute[71692]: INFO nova.compute.manager [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Took 6.44 seconds to spawn the instance on the hypervisor.
Apr 13 19:17:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:17:36 user nova-compute[71692]: DEBUG nova.compute.manager [req-cd5151b4-76c4-4402-a045-36645cb38d15 req-f491b20b-a83e-409c-b1f7-f5a30106a742 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received event network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:17:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cd5151b4-76c4-4402-a045-36645cb38d15 req-f491b20b-a83e-409c-b1f7-f5a30106a742 service nova] Acquiring lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:17:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cd5151b4-76c4-4402-a045-36645cb38d15 req-f491b20b-a83e-409c-b1f7-f5a30106a742 service nova] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:17:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cd5151b4-76c4-4402-a045-36645cb38d15 req-f491b20b-a83e-409c-b1f7-f5a30106a742 service nova] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:17:36 user nova-compute[71692]: DEBUG nova.compute.manager [req-cd5151b4-76c4-4402-a045-36645cb38d15 req-f491b20b-a83e-409c-b1f7-f5a30106a742 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] No waiting events found dispatching network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:17:36 user nova-compute[71692]: WARNING nova.compute.manager [req-cd5151b4-76c4-4402-a045-36645cb38d15 req-f491b20b-a83e-409c-b1f7-f5a30106a742 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received unexpected event network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance with vm_state building and task_state spawning.
Apr 13 19:17:36 user nova-compute[71692]: INFO nova.compute.manager [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Took 7.09 seconds to build instance.
Apr 13 19:17:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-999fcf7e-4062-4fd2-a966-5dd5b31de424 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.181s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:17:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:40 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:17:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:17:42 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:17:44 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:17:44 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:17:45 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:17:46 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:17:46 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:17:46 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:17:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:17:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:17:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:17:46 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:17:46 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:17:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:46 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:17:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:49 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:17:49 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=7979MB free_disk=26.077503204345703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 59d7b86a-c723-4255-827e-2f6a641239df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 579c83e7-7976-47f4-9f25-a194e39966ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 01bd39f7-7d27-48cf-982e-181aadc060ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 080204b2-fd4d-4224-b391-a27036d058ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance a9f3d080-a163-4897-9187-2687cae49694 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 166341f7-a5fa-4034-8281-6aed0be1bd5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing inventories for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating ProviderTree inventory for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating inventory in ProviderTree for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing aggregate associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, aggregates: None {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing trait associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:17:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:17:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:52 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:17:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:17:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:17:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:17:52 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:17:52 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Updating instance_info_cache with network_info: [{"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:17:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:17:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:17:52 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:17:52 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:17:52 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:17:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 19:17:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] There are 0 instances to clean {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 19:17:52 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:17:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 19:17:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:17:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:17:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:17:58 user nova-compute[71692]: DEBUG nova.objects.instance [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'flavor' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:17:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:17:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:17:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:17:58 user nova-compute[71692]: INFO nova.compute.manager [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Attaching volume b2103249-cfef-4cba-a24a-59e3c4d3be1d to /dev/vdb
Apr 13 19:17:59 user nova-compute[71692]: DEBUG os_brick.utils [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[48398c66-0795-4e42-b47a-c6ece9d7ae8e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c52636-83d1-4242-87d2-5e5765f834fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f4dbd2-db6e-46b9-8743-e0bc5421268c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e638f2-7453-448f-807e-1804d7e922db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:17:59 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:17:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[519f2581-f0c8-4c1e-83c6-726bc9abf963]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG os_brick.utils [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:17:59 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Updating existing volume attachment record: 51b9f8d7-0528-4c41-bc28-6cf4ee6d9e89 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:18:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-f2e8f4e4-13bb-4e47-bf9a-466f75636e4b req-eb924957-fa23-425a-ba88-46f346847768 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-changed-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:18:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-f2e8f4e4-13bb-4e47-bf9a-466f75636e4b req-eb924957-fa23-425a-ba88-46f346847768 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Refreshing instance network info cache due to event network-changed-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:18:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f2e8f4e4-13bb-4e47-bf9a-466f75636e4b req-eb924957-fa23-425a-ba88-46f346847768 service nova] Acquiring lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:18:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f2e8f4e4-13bb-4e47-bf9a-466f75636e4b req-eb924957-fa23-425a-ba88-46f346847768 service nova] Acquired lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:18:01 user nova-compute[71692]: DEBUG nova.network.neutron [req-f2e8f4e4-13bb-4e47-bf9a-466f75636e4b req-eb924957-fa23-425a-ba88-46f346847768 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Refreshing network info cache for port 508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:18:02 user nova-compute[71692]: INFO nova.compute.manager [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Detaching volume ecf4fd59-73f4-48eb-881a-97c8fbb14959
Apr 13 19:18:02 user nova-compute[71692]: INFO nova.virt.block_device [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Attempting to driver detach volume ecf4fd59-73f4-48eb-881a-97c8fbb14959 from mountpoint /dev/vdb
Apr 13 19:18:02 user nova-compute[71692]: DEBUG nova.network.neutron [req-f2e8f4e4-13bb-4e47-bf9a-466f75636e4b req-eb924957-fa23-425a-ba88-46f346847768 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Updated VIF entry in instance network info cache for port 508dc44c-24c7-4474-9d8a-8cd8a20fa1d6. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG nova.network.neutron [req-f2e8f4e4-13bb-4e47-bf9a-466f75636e4b req-eb924957-fa23-425a-ba88-46f346847768 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Updating instance_info_cache with network_info: [{"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Attempting to detach device vdb from instance 01bd39f7-7d27-48cf-982e-181aadc060ab from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:18:02 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:18:02 user nova-compute[71692]:   <source dev="/dev/sde"/>
Apr 13 19:18:02 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:18:02 user nova-compute[71692]:   <serial>ecf4fd59-73f4-48eb-881a-97c8fbb14959</serial>
Apr 13 19:18:02 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:18:02 user nova-compute[71692]: </disk>
Apr 13 19:18:02 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f2e8f4e4-13bb-4e47-bf9a-466f75636e4b req-eb924957-fa23-425a-ba88-46f346847768 service nova] Releasing lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:18:02 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Successfully detached device vdb from instance 01bd39f7-7d27-48cf-982e-181aadc060ab from the persistent domain config.
Apr 13 19:18:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01bd39f7-7d27-48cf-982e-181aadc060ab from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:18:02 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:18:02 user nova-compute[71692]:   <source dev="/dev/sde"/>
Apr 13 19:18:02 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:18:02 user nova-compute[71692]:   <serial>ecf4fd59-73f4-48eb-881a-97c8fbb14959</serial>
Apr 13 19:18:02 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:18:02 user nova-compute[71692]: </disk>
Apr 13 19:18:02 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681413482.6486762, 01bd39f7-7d27-48cf-982e-181aadc060ab => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01bd39f7-7d27-48cf-982e-181aadc060ab {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:18:02 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Successfully detached device vdb from instance 01bd39f7-7d27-48cf-982e-181aadc060ab from the live domain config.
Apr 13 19:18:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HwnECePL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:18:02 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a41d75-0790-4306-9fcb-c5f8f28d40c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:18:02 user nova-compute[71692]: No targets found.
Apr 13 19:18:02 user nova-compute[71692]: iSNS:
Apr 13 19:18:02 user nova-compute[71692]: No targets found.
Apr 13 19:18:02 user nova-compute[71692]: STATIC:
Apr 13 19:18:02 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959
Apr 13 19:18:02 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:18:02 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:18:02 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2
Apr 13 19:18:02 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:18:02 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:18:02 user nova-compute[71692]: FIRMWARE:
Apr 13 19:18:02 user nova-compute[71692]: No targets found.
Apr 13 19:18:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:18:02 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:18:02 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f391ccef-d59d-4337-a6a3-20bf7306aada]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e232a0ce-9fb5-458f-8170-e196d63d80f4]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:18:02 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:18:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 (non-flash)
Apr 13 19:18:02 user nova-compute[71692]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:18:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febc4265cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959'): ({'sde'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Removing single pathed devices sde {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8a9b6c-21ff-4858-b834-197990828b42]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[33798009-3871-459f-8326-b69dab99ee86]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Flushing IO for device /dev/sde {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d455705-44c7-4f28-b9eb-3d6691210804]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaecc4d-36d1-4a8a-b43a-847c48e7807f]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] SCSI volumes sde have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db50cf0-6ffa-433e-9def-b040b0519cd8]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c121e82c-70a8-4e3d-8978-e4ad85a2febf]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959, portal: 172.16.0.220,3260]
Apr 13 19:18:02 user nova-compute[71692]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959, portal: 172.16.0.220,3260] successful.
Apr 13 19:18:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ecf4fd59-73f4-48eb-881a-97c8fbb14959 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a3e04d-b8c5-4c6b-8a43-a159a791c10b]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] <== disconnect_volume: return (298ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:18:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:18:03 user nova-compute[71692]: DEBUG nova.compute.manager [req-4a35efe8-3593-45fd-ad33-151b7bd23474 req-616054e4-91e8-4913-bb54-ba85e319dbcb service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-changed-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:18:03 user nova-compute[71692]: DEBUG nova.compute.manager [req-4a35efe8-3593-45fd-ad33-151b7bd23474 req-616054e4-91e8-4913-bb54-ba85e319dbcb service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Refreshing instance network info cache due to event network-changed-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:18:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4a35efe8-3593-45fd-ad33-151b7bd23474 req-616054e4-91e8-4913-bb54-ba85e319dbcb service nova] Acquiring lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:18:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4a35efe8-3593-45fd-ad33-151b7bd23474 req-616054e4-91e8-4913-bb54-ba85e319dbcb service nova] Acquired lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:18:03 user nova-compute[71692]: DEBUG nova.network.neutron [req-4a35efe8-3593-45fd-ad33-151b7bd23474 req-616054e4-91e8-4913-bb54-ba85e319dbcb service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Refreshing network info cache for port 508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:18:03 user nova-compute[71692]: DEBUG nova.objects.instance [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'flavor' on Instance uuid 01bd39f7-7d27-48cf-982e-181aadc060ab {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:18:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-90e94880-a093-490a-937c-01a6052731e8 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.710s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:18:04 user nova-compute[71692]: DEBUG nova.network.neutron [req-4a35efe8-3593-45fd-ad33-151b7bd23474 req-616054e4-91e8-4913-bb54-ba85e319dbcb service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Updated VIF entry in instance network info cache for port 508dc44c-24c7-4474-9d8a-8cd8a20fa1d6. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:18:04 user nova-compute[71692]: DEBUG nova.network.neutron [req-4a35efe8-3593-45fd-ad33-151b7bd23474 req-616054e4-91e8-4913-bb54-ba85e319dbcb service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Updating instance_info_cache with network_info: [{"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:18:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4a35efe8-3593-45fd-ad33-151b7bd23474 req-616054e4-91e8-4913-bb54-ba85e319dbcb service nova] Releasing lock "refresh_cache-01bd39f7-7d27-48cf-982e-181aadc060ab" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSMAPmoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:18:05 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:18:05 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:18:05 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c5b51f-6cb0-434f-9dda-5a23d2c62985]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:18:05 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9785f1c-27a7-440b-915b-ea779eaf83f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d] added
Apr 13 19:18:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.053s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c5a025-6a89-49db-a657-c594b7298a75]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aca80b0-9704-4a8b-b9dd-568074198791]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HSMAPmoX {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HSMAPmoX" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40c11d2-3bb6-48ed-a99d-28ff2ea8922e]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HSMAPmoX'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[835c1799-bc22-42bd-8c10-67a852dcd203]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5322e83-365a-4548-9d52-c6b485fde31c]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:18:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:18:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaaa349-5d6d-45af-ad5e-fb53aac4b37f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d, portal: 172.16.0.220,3260]
Apr 13 19:18:05 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d, portal: 172.16.0.220,3260] successful.
Apr 13 19:18:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ff4e1a-0e07-45ec-bce0-d2e385398eff]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[afac806c-f278-47ad-b944-d15dce72a0e0]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:18:05 user nova-compute[71692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d (non-flash)
Apr 13 19:18:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:18:05 user nova-compute[71692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d (non-flash)
Apr 13 19:18:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b591edfa-5010-4b16-a3d6-f2c7c610d2ff]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:05 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:18:06 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:18:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSMAPmoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:18:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:18:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23132383062646166', 'path': '/dev/sdc'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:18:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132383062646166', 'path': '/dev/sdc'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:18:06 user nova-compute[71692]: DEBUG nova.objects.instance [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'flavor' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:18:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:18:06 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:18:06 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:18:06 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:18:06 user nova-compute[71692]:   <serial>b2103249-cfef-4cba-a24a-59e3c4d3be1d</serial>
Apr 13 19:18:06 user nova-compute[71692]: </disk>
Apr 13 19:18:06 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:18:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:18:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:18:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] No VIF found with MAC fa:16:3e:8e:c2:1f, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:18:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d0c3621a-be19-4366-9a9a-9bbe09b8cd29 tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.966s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:18:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:18:08 user nova-compute[71692]: INFO nova.compute.manager [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Detaching volume b2103249-cfef-4cba-a24a-59e3c4d3be1d
Apr 13 19:18:08 user nova-compute[71692]: INFO nova.virt.block_device [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Attempting to driver detach volume b2103249-cfef-4cba-a24a-59e3c4d3be1d from mountpoint /dev/vdb
Apr 13 19:18:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Attempting to detach device vdb from instance 080204b2-fd4d-4224-b391-a27036d058ac from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:18:08 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:18:08 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:18:08 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:18:08 user nova-compute[71692]:   <serial>b2103249-cfef-4cba-a24a-59e3c4d3be1d</serial>
Apr 13 19:18:08 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:18:08 user nova-compute[71692]: </disk>
Apr 13 19:18:08 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:18:08 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Successfully detached device vdb from instance 080204b2-fd4d-4224-b391-a27036d058ac from the persistent domain config.
Apr 13 19:18:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 080204b2-fd4d-4224-b391-a27036d058ac from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:18:08 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:18:08 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:18:08 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:18:08 user nova-compute[71692]:   <serial>b2103249-cfef-4cba-a24a-59e3c4d3be1d</serial>
Apr 13 19:18:08 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:18:08 user nova-compute[71692]: </disk>
Apr 13 19:18:08 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681413488.689738, 080204b2-fd4d-4224-b391-a27036d058ac => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:18:08 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Successfully detached device vdb from instance 080204b2-fd4d-4224-b391-a27036d058ac from the live domain config.
Apr 13 19:18:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSMAPmoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:18:08 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9738df0-2478-4c54-ad49-263acabda080]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:18:08 user nova-compute[71692]: No targets found.
Apr 13 19:18:08 user nova-compute[71692]: iSNS:
Apr 13 19:18:08 user nova-compute[71692]: No targets found.
Apr 13 19:18:08 user nova-compute[71692]: STATIC:
Apr 13 19:18:08 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d
Apr 13 19:18:08 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:18:08 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:18:08 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2
Apr 13 19:18:08 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:18:08 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:18:08 user nova-compute[71692]: FIRMWARE:
Apr 13 19:18:08 user nova-compute[71692]: No targets found.
Apr 13 19:18:08 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:18:08 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:18:08 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b108324f-415f-48f1-bafa-1ba0ede88f36]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bab50b-f262-43bf-936f-3e31cf77a259]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:18:08 user nova-compute[71692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d (non-flash)
Apr 13 19:18:08 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:18:08 user nova-compute[71692]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d (non-flash)
Apr 13 19:18:08 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febc4266b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d'): ({'sdc'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Removing single pathed devices sdc {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffb929a-b41a-46c2-965a-36c4569c8e45]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d009555-7507-4c11-afa9-3ae610f9b75d]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Flushing IO for device /dev/sdc {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8fdf8d-0440-458d-ad68-99cef0b24d78]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6141c343-3241-4c73-b780-e10d5acad5a2]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fd2236-309f-4d3b-ba8c-3b897cfca37d]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60d02ea-14d0-49f4-a3c8-61dc8d7af6ab]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d, portal: 172.16.0.220,3260]
Apr 13 19:18:08 user nova-compute[71692]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d, portal: 172.16.0.220,3260] successful.
Apr 13 19:18:08 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2103249-cfef-4cba-a24a-59e3c4d3be1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a9b5f5-d16f-45c6-8c5a-09d53e4100fe]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] <== disconnect_volume: return (281ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:18:08 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:18:09 user nova-compute[71692]: DEBUG nova.objects.instance [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'flavor' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:18:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c7a0d996-61db-428b-a2f0-234cce3ea84d tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.674s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:18:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:18:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "166341f7-a5fa-4034-8281-6aed0be1bd5a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG nova.objects.instance [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lazy-loading 'flavor' on Instance uuid 166341f7-a5fa-4034-8281-6aed0be1bd5a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:18:33 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Ignoring supplied device name: /dev/vdb
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "166341f7-a5fa-4034-8281-6aed0be1bd5a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:18:33 user nova-compute[71692]: INFO nova.compute.manager [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Attaching volume 3d88d4ba-5a52-4f06-bd94-1f00beadd50b to /dev/vdb
Apr 13 19:18:33 user nova-compute[71692]: DEBUG os_brick.utils [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[99510ad5-3fe8-4cd0-9c96-87b625832af3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7230ddf8-2dd9-41dc-a4b3-c7f26641cb46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[013b7c9c-9e60-4879-b587-c812d897babc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[87636f26-8b56-4360-bcd4-2e269bae0f02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:18:33 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:18:33 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a551a015-afc4-4163-9959-49c135745f6f]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG os_brick.utils [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:18:33 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Updating existing volume attachment record: f56852d3-3467-4ce8-a63d-484923c0ca75 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:18:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:38 user nova-compute[71692]: INFO nova.compute.manager [None req-77326980-6614-47d1-ae61-f96a78063bf1 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Get console output
Apr 13 19:18:38 user nova-compute[71692]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 13 19:18:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovOfJetV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:18:39 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:18:39 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:18:39 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[965beea2-465d-40c5-a183-4500ec69c1fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:18:39 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[66caf519-81fa-4fa6-b812-874fa9cebdb9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b] added
Apr 13 19:18:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a66fa7-1bd4-4da2-9f79-2955ab454723]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fada2b-6a58-4310-a8d5-aa021668fc68]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ovOfJetV {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ovOfJetV" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2696fd64-b33d-4d53-9c98-baab83f9d5fe]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ovOfJetV'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c794eda-5907-467d-b836-350ba09f9411]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1f8cde-9b10-4e6d-b352-572c96f117db]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:18:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:18:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9354b8-cd43-44ea-93dd-7420b4b6edbc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b, portal: 172.16.0.220,3260]
Apr 13 19:18:39 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b, portal: 172.16.0.220,3260] successful.
Apr 13 19:18:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f459b05-f603-44bf-bba4-a65f38ae26d2]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5611ce3-82e0-4c78-8329-fea13908fd77]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:18:39 user nova-compute[71692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b (non-flash)
Apr 13 19:18:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:18:39 user nova-compute[71692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b (non-flash)
Apr 13 19:18:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad04dca-03c6-47af-a1c8-3d373b8ff492]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:18:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovOfJetV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:18:40 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:18:40 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23833336136343936', 'path': '/dev/sdc'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:18:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833336136343936', 'path': '/dev/sdc'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:18:40 user nova-compute[71692]: DEBUG nova.objects.instance [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lazy-loading 'flavor' on Instance uuid 166341f7-a5fa-4034-8281-6aed0be1bd5a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:18:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:18:40 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:18:40 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:18:40 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:18:40 user nova-compute[71692]:   <serial>3d88d4ba-5a52-4f06-bd94-1f00beadd50b</serial>
Apr 13 19:18:40 user nova-compute[71692]: </disk>
Apr 13 19:18:40 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:18:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:18:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:18:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] No VIF found with MAC fa:16:3e:c6:17:d6, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:18:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7064a820-0537-43ef-8d4c-e19a27afb604 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.242s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:18:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:42 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:18:44 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:18:45 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:18:46 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:18:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:47 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:18:47 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:18:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:18:48 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:18:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:18:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:18:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:18:48 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:18:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:18:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:50 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:18:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:51 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:18:51 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:18:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8055MB free_disk=26.053855895996094GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:18:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:18:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:18:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:18:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 59d7b86a-c723-4255-827e-2f6a641239df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:18:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 579c83e7-7976-47f4-9f25-a194e39966ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:18:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 01bd39f7-7d27-48cf-982e-181aadc060ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:18:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 080204b2-fd4d-4224-b391-a27036d058ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:18:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance a9f3d080-a163-4897-9187-2687cae49694 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:18:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 166341f7-a5fa-4034-8281-6aed0be1bd5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:18:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:18:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:18:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:18:51 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:18:51 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:18:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:18:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:18:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:18:52 user nova-compute[71692]: INFO nova.compute.manager [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Terminating instance
Apr 13 19:18:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Skipping network cache update for instance because it is being deleted. {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG nova.objects.instance [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lazy-loading 'info_cache' on Instance uuid 29eeca99-f237-49d9-9c7d-5c5b7ff2892f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG nova.compute.manager [req-b00037f3-87b3-4e6a-96fc-d78b2100ba1f req-2a49d1d9-cca8-4403-b076-85ac6944dbca service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-vif-unplugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b00037f3-87b3-4e6a-96fc-d78b2100ba1f req-2a49d1d9-cca8-4403-b076-85ac6944dbca service nova] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b00037f3-87b3-4e6a-96fc-d78b2100ba1f req-2a49d1d9-cca8-4403-b076-85ac6944dbca service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b00037f3-87b3-4e6a-96fc-d78b2100ba1f req-2a49d1d9-cca8-4403-b076-85ac6944dbca service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG nova.compute.manager [req-b00037f3-87b3-4e6a-96fc-d78b2100ba1f req-2a49d1d9-cca8-4403-b076-85ac6944dbca service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] No waiting events found dispatching network-vif-unplugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG nova.compute.manager [req-b00037f3-87b3-4e6a-96fc-d78b2100ba1f req-2a49d1d9-cca8-4403-b076-85ac6944dbca service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-vif-unplugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:53 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Instance destroyed successfully.
Apr 13 19:18:53 user nova-compute[71692]: DEBUG nova.objects.instance [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'resources' on Instance uuid 01bd39f7-7d27-48cf-982e-181aadc060ab {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:18:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:12:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-243833659',display_name='tempest-ServerRescueNegativeTestJSON-server-243833659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-243833659',id=26,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETrtalpYQPcSKz1Uvc8zhcl0TlkdLfnCDAYE9b0Gxj6dj83NAjoPt6+VcHDiCV3eWgdAtbJV8ZhOtBKhYZ+l/OE7pG32jVdqRo02bInWOOtIHlsQQihOwUoItSmHcTOUw==',key_name='tempest-keypair-1767392597',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:14:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42fbd7089a7e4ba8b2597fca0d8e84c8',ramdisk_id='',reservation_id='r-vhean6yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1255770111',owner_user_name='tempest-ServerRescueNegativeTestJSON-1255770111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bebf61a7401492692f9c60adde178f7',uuid=01bd39f7-7d27-48cf-982e-181aadc060ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:18:53 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converting VIF {"id": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "address": "fa:16:3e:5a:81:9c", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap508dc44c-24", "ovs_interfaceid": "508dc44c-24c7-4474-9d8a-8cd8a20fa1d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:18:53 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:81:9c,bridge_name='br-int',has_traffic_filtering=True,id=508dc44c-24c7-4474-9d8a-8cd8a20fa1d6,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap508dc44c-24') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:18:53 user nova-compute[71692]: DEBUG os_vif [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:81:9c,bridge_name='br-int',has_traffic_filtering=True,id=508dc44c-24c7-4474-9d8a-8cd8a20fa1d6,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap508dc44c-24') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:18:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap508dc44c-24, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:18:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:18:53 user nova-compute[71692]: INFO os_vif [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:81:9c,bridge_name='br-int',has_traffic_filtering=True,id=508dc44c-24c7-4474-9d8a-8cd8a20fa1d6,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap508dc44c-24')
Apr 13 19:18:53 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Deleting instance files /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab_del
Apr 13 19:18:53 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Deletion of /opt/stack/data/nova/instances/01bd39f7-7d27-48cf-982e-181aadc060ab_del complete
Apr 13 19:18:53 user nova-compute[71692]: INFO nova.compute.manager [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 13 19:18:53 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:18:53 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:18:53 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:18:53 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Updating instance_info_cache with network_info: [{"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:18:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-29eeca99-f237-49d9-9c7d-5c5b7ff2892f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:18:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:18:53 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:18:53 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:18:54 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:18:54 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Took 0.85 seconds to deallocate network for instance.
Apr 13 19:18:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:18:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:18:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-7f8a8707-0c60-4750-9037-126ac06e8df1 req-8d9a2435-7051-403e-b71b-4f4f5e4961ca service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-vif-deleted-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:18:54 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:18:54 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:18:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:18:54 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Deleted allocations for instance 01bd39f7-7d27-48cf-982e-181aadc060ab
Apr 13 19:18:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-3639f07d-931c-4739-8b11-09dfe1531c71 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.178s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:18:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-f0773b66-8466-4e9c-8e4d-031d57407e6e req-0c6486fe-312f-47bd-8568-e66f40eee2b7 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:18:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f0773b66-8466-4e9c-8e4d-031d57407e6e req-0c6486fe-312f-47bd-8568-e66f40eee2b7 service nova] Acquiring lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:18:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f0773b66-8466-4e9c-8e4d-031d57407e6e req-0c6486fe-312f-47bd-8568-e66f40eee2b7 service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:18:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f0773b66-8466-4e9c-8e4d-031d57407e6e req-0c6486fe-312f-47bd-8568-e66f40eee2b7 service nova] Lock "01bd39f7-7d27-48cf-982e-181aadc060ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:18:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-f0773b66-8466-4e9c-8e4d-031d57407e6e req-0c6486fe-312f-47bd-8568-e66f40eee2b7 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] No waiting events found dispatching network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:18:54 user nova-compute[71692]: WARNING nova.compute.manager [req-f0773b66-8466-4e9c-8e4d-031d57407e6e req-0c6486fe-312f-47bd-8568-e66f40eee2b7 service nova] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Received unexpected event network-vif-plugged-508dc44c-24c7-4474-9d8a-8cd8a20fa1d6 for instance with vm_state deleted and task_state None.
Apr 13 19:18:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "166341f7-a5fa-4034-8281-6aed0be1bd5a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:18:58 user nova-compute[71692]: INFO nova.compute.manager [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Detaching volume 3d88d4ba-5a52-4f06-bd94-1f00beadd50b
Apr 13 19:18:58 user nova-compute[71692]: INFO nova.virt.block_device [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Attempting to driver detach volume 3d88d4ba-5a52-4f06-bd94-1f00beadd50b from mountpoint /dev/vdb
Apr 13 19:18:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Attempting to detach device vdb from instance 166341f7-a5fa-4034-8281-6aed0be1bd5a from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:18:58 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:18:58 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:18:58 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:18:58 user nova-compute[71692]:   <serial>3d88d4ba-5a52-4f06-bd94-1f00beadd50b</serial>
Apr 13 19:18:58 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:18:58 user nova-compute[71692]: </disk>
Apr 13 19:18:58 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:18:58 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Successfully detached device vdb from instance 166341f7-a5fa-4034-8281-6aed0be1bd5a from the persistent domain config.
Apr 13 19:18:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 166341f7-a5fa-4034-8281-6aed0be1bd5a from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:18:58 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:18:58 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:18:58 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:18:58 user nova-compute[71692]:   <serial>3d88d4ba-5a52-4f06-bd94-1f00beadd50b</serial>
Apr 13 19:18:58 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:18:58 user nova-compute[71692]: </disk>
Apr 13 19:18:58 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "166341f7-a5fa-4034-8281-6aed0be1bd5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681413538.9183407, 166341f7-a5fa-4034-8281-6aed0be1bd5a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 166341f7-a5fa-4034-8281-6aed0be1bd5a {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:18:58 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Successfully detached device vdb from instance 166341f7-a5fa-4034-8281-6aed0be1bd5a from the live domain config.
Apr 13 19:18:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovOfJetV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:18:58 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:18:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0248cb91-b4ba-4e4d-b9d3-3bcfccbf74a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:18:58 user nova-compute[71692]: No targets found.
Apr 13 19:18:58 user nova-compute[71692]: iSNS:
Apr 13 19:18:58 user nova-compute[71692]: No targets found.
Apr 13 19:18:58 user nova-compute[71692]: STATIC:
Apr 13 19:18:58 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b
Apr 13 19:18:58 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:18:58 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:18:58 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2
Apr 13 19:18:58 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:18:58 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:18:58 user nova-compute[71692]: FIRMWARE:
Apr 13 19:18:58 user nova-compute[71692]: No targets found.
Apr 13 19:18:58 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:18:58 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:18:58 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccb0abd-1cd3-4d2a-8d00-16302e4a8cac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[41132b30-f106-4278-8a4f-29c295224e88]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:18:59 user nova-compute[71692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b (non-flash)
Apr 13 19:18:59 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:18:59 user nova-compute[71692]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b (non-flash)
Apr 13 19:18:59 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febc42c7370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b'): ({'sdc'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Removing single pathed devices sdc {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6539d4b-2926-4f7e-8807-7c5f4ab27f9d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c229ae6d-2fdb-4a90-81bc-8c733958206b]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Flushing IO for device /dev/sdc {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[012109d7-f179-441a-a235-21aa2b5f154b]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[407ce085-d99a-4e8b-9d01-3510364a180d]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c813252-4919-4bf6-86ab-cb5e8d9c3e9e]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e920ed91-113a-480e-97cb-2b6ba3c47ca2]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b, portal: 172.16.0.220,3260]
Apr 13 19:18:59 user nova-compute[71692]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b, portal: 172.16.0.220,3260] successful.
Apr 13 19:18:59 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49d2545-90f0-4d7d-99fa-524a7428ea7a]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] <== disconnect_volume: return (277ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:18:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG nova.objects.instance [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lazy-loading 'flavor' on Instance uuid 166341f7-a5fa-4034-8281-6aed0be1bd5a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-53e8ef0e-99aa-4c80-967d-66ace2c960a2 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.700s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.586s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "166341f7-a5fa-4034-8281-6aed0be1bd5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:00 user nova-compute[71692]: INFO nova.compute.manager [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Terminating instance
Apr 13 19:19:00 user nova-compute[71692]: DEBUG nova.compute.manager [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-3bd8e87a-2e69-4a13-ac8c-6ac435e35ad5 req-491761ba-dd58-4a17-bdca-ba74ae0842da service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Received event network-vif-unplugged-3e4a73da-8c31-4a03-a16a-69ff3f84b550 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3bd8e87a-2e69-4a13-ac8c-6ac435e35ad5 req-491761ba-dd58-4a17-bdca-ba74ae0842da service nova] Acquiring lock "166341f7-a5fa-4034-8281-6aed0be1bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3bd8e87a-2e69-4a13-ac8c-6ac435e35ad5 req-491761ba-dd58-4a17-bdca-ba74ae0842da service nova] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3bd8e87a-2e69-4a13-ac8c-6ac435e35ad5 req-491761ba-dd58-4a17-bdca-ba74ae0842da service nova] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-3bd8e87a-2e69-4a13-ac8c-6ac435e35ad5 req-491761ba-dd58-4a17-bdca-ba74ae0842da service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] No waiting events found dispatching network-vif-unplugged-3e4a73da-8c31-4a03-a16a-69ff3f84b550 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-3bd8e87a-2e69-4a13-ac8c-6ac435e35ad5 req-491761ba-dd58-4a17-bdca-ba74ae0842da service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Received event network-vif-unplugged-3e4a73da-8c31-4a03-a16a-69ff3f84b550 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:19:00 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Instance destroyed successfully.
Apr 13 19:19:00 user nova-compute[71692]: DEBUG nova.objects.instance [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lazy-loading 'resources' on Instance uuid 166341f7-a5fa-4034-8281-6aed0be1bd5a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:16:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-430407348',display_name='tempest-VolumesSnapshotTestJSON-instance-430407348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-430407348',id=31,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:16:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='024f13d8c179482791ed1545b6b2efd8',ramdisk_id='',reservation_id='r-c66vqa7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-613917248',owner_user_name='tempest-VolumesSnapshotTestJSON-613917248-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:16:49Z,user_data=None,user_id='789fdd98ede74e6783b667178c2689fb',uuid=166341f7-a5fa-4034-8281-6aed0be1bd5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "address": "fa:16:3e:c6:17:d6", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4a73da-8c", "ovs_interfaceid": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Converting VIF {"id": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "address": "fa:16:3e:c6:17:d6", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e4a73da-8c", "ovs_interfaceid": "3e4a73da-8c31-4a03-a16a-69ff3f84b550", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:17:d6,bridge_name='br-int',has_traffic_filtering=True,id=3e4a73da-8c31-4a03-a16a-69ff3f84b550,network=Network(0e855c73-cf7d-4c09-9fb5-3a4a7903b519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4a73da-8c') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG os_vif [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:17:d6,bridge_name='br-int',has_traffic_filtering=True,id=3e4a73da-8c31-4a03-a16a-69ff3f84b550,network=Network(0e855c73-cf7d-4c09-9fb5-3a4a7903b519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4a73da-8c') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e4a73da-8c, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:19:00 user nova-compute[71692]: INFO os_vif [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:17:d6,bridge_name='br-int',has_traffic_filtering=True,id=3e4a73da-8c31-4a03-a16a-69ff3f84b550,network=Network(0e855c73-cf7d-4c09-9fb5-3a4a7903b519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e4a73da-8c')
Apr 13 19:19:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovOfJetV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:19:00 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:19:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcf22eb-1248-4558-96d7-907389d05712]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:19:00 user nova-compute[71692]: No targets found.
Apr 13 19:19:00 user nova-compute[71692]: iSNS:
Apr 13 19:19:00 user nova-compute[71692]: No targets found.
Apr 13 19:19:00 user nova-compute[71692]: STATIC:
Apr 13 19:19:00 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2
Apr 13 19:19:00 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:19:00 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:19:00 user nova-compute[71692]: FIRMWARE:
Apr 13 19:19:00 user nova-compute[71692]: No targets found.
Apr 13 19:19:00 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:19:00 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:19:00 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d88d4ba-5a52-4f06-bd94-1f00beadd50b', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[93625200-d920-49a0-96f4-53699282affd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d108f53-c1b1-4e1f-b59c-1066fc1e8557]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:19:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:19:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:19:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:19:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc291ab0>, {}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:19:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Disconnecting from: [] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:19:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:19:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] <== disconnect_volume: return (70ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:19:01 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:19:01 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Deleting instance files /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a_del
Apr 13 19:19:01 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Deletion of /opt/stack/data/nova/instances/166341f7-a5fa-4034-8281-6aed0be1bd5a_del complete
Apr 13 19:19:01 user nova-compute[71692]: INFO nova.compute.manager [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 13 19:19:01 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:19:01 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:19:01 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:19:01 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:19:01 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Took 0.46 seconds to deallocate network for instance.
Apr 13 19:19:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-1589c9d2-289f-41d9-a6c5-bbf71d9b1b2d req-df7629b1-a4e3-4f00-9ea8-12645eff116d service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Received event network-vif-deleted-3e4a73da-8c31-4a03-a16a-69ff3f84b550 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:01 user nova-compute[71692]: INFO nova.compute.manager [req-1589c9d2-289f-41d9-a6c5-bbf71d9b1b2d req-df7629b1-a4e3-4f00-9ea8-12645eff116d service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Neutron deleted interface 3e4a73da-8c31-4a03-a16a-69ff3f84b550; detaching it from the instance and deleting it from the info cache
Apr 13 19:19:01 user nova-compute[71692]: DEBUG nova.network.neutron [req-1589c9d2-289f-41d9-a6c5-bbf71d9b1b2d req-df7629b1-a4e3-4f00-9ea8-12645eff116d service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:19:01 user nova-compute[71692]: WARNING nova.volume.cinder [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Attachment f56852d3-3467-4ce8-a63d-484923c0ca75 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = f56852d3-3467-4ce8-a63d-484923c0ca75. (HTTP 404) (Request-ID: req-12c08d8f-7a15-4773-bddb-7de122b78073)
Apr 13 19:19:01 user nova-compute[71692]: INFO nova.compute.manager [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Took 0.02 seconds to detach 1 volumes for instance.
Apr 13 19:19:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-1589c9d2-289f-41d9-a6c5-bbf71d9b1b2d req-df7629b1-a4e3-4f00-9ea8-12645eff116d service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Detach interface failed, port_id=3e4a73da-8c31-4a03-a16a-69ff3f84b550, reason: Instance 166341f7-a5fa-4034-8281-6aed0be1bd5a could not be found. {{(pid=71692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 19:19:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:01 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:19:01 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:19:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:01 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Deleted allocations for instance 166341f7-a5fa-4034-8281-6aed0be1bd5a
Apr 13 19:19:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-416f1388-a009-4e5c-be84-55e4ebca5212 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.828s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:02 user nova-compute[71692]: DEBUG nova.compute.manager [req-6d81173e-9622-4cf5-84e7-650548f411b6 req-a8efb6e4-840d-4cff-a173-b1f9b02472d8 service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Received event network-vif-plugged-3e4a73da-8c31-4a03-a16a-69ff3f84b550 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6d81173e-9622-4cf5-84e7-650548f411b6 req-a8efb6e4-840d-4cff-a173-b1f9b02472d8 service nova] Acquiring lock "166341f7-a5fa-4034-8281-6aed0be1bd5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6d81173e-9622-4cf5-84e7-650548f411b6 req-a8efb6e4-840d-4cff-a173-b1f9b02472d8 service nova] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6d81173e-9622-4cf5-84e7-650548f411b6 req-a8efb6e4-840d-4cff-a173-b1f9b02472d8 service nova] Lock "166341f7-a5fa-4034-8281-6aed0be1bd5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:02 user nova-compute[71692]: DEBUG nova.compute.manager [req-6d81173e-9622-4cf5-84e7-650548f411b6 req-a8efb6e4-840d-4cff-a173-b1f9b02472d8 service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] No waiting events found dispatching network-vif-plugged-3e4a73da-8c31-4a03-a16a-69ff3f84b550 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:19:02 user nova-compute[71692]: WARNING nova.compute.manager [req-6d81173e-9622-4cf5-84e7-650548f411b6 req-a8efb6e4-840d-4cff-a173-b1f9b02472d8 service nova] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Received unexpected event network-vif-plugged-3e4a73da-8c31-4a03-a16a-69ff3f84b550 for instance with vm_state deleted and task_state None.
Apr 13 19:19:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:19:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:19:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:19:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:19:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:19:08 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413533.2409503, 01bd39f7-7d27-48cf-982e-181aadc060ab => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:19:08 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] VM Stopped (Lifecycle Event)
Apr 13 19:19:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d01cb7c5-6efa-4e85-9b16-c4645a1ce348 None None] [instance: 01bd39f7-7d27-48cf-982e-181aadc060ab] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:19:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-4654a459-2373-48a4-8627-e0eb4987bc7c req-464f9e33-6d42-4503-af78-903cf9e4fcf8 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Received event network-changed-a29956b4-c9c2-4c86-bf4a-488fb5f45af0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-4654a459-2373-48a4-8627-e0eb4987bc7c req-464f9e33-6d42-4503-af78-903cf9e4fcf8 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Refreshing instance network info cache due to event network-changed-a29956b4-c9c2-4c86-bf4a-488fb5f45af0. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:19:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4654a459-2373-48a4-8627-e0eb4987bc7c req-464f9e33-6d42-4503-af78-903cf9e4fcf8 service nova] Acquiring lock "refresh_cache-080204b2-fd4d-4224-b391-a27036d058ac" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:19:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4654a459-2373-48a4-8627-e0eb4987bc7c req-464f9e33-6d42-4503-af78-903cf9e4fcf8 service nova] Acquired lock "refresh_cache-080204b2-fd4d-4224-b391-a27036d058ac" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:19:12 user nova-compute[71692]: DEBUG nova.network.neutron [req-4654a459-2373-48a4-8627-e0eb4987bc7c req-464f9e33-6d42-4503-af78-903cf9e4fcf8 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Refreshing network info cache for port a29956b4-c9c2-4c86-bf4a-488fb5f45af0 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:19:13 user nova-compute[71692]: DEBUG nova.network.neutron [req-4654a459-2373-48a4-8627-e0eb4987bc7c req-464f9e33-6d42-4503-af78-903cf9e4fcf8 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Updated VIF entry in instance network info cache for port a29956b4-c9c2-4c86-bf4a-488fb5f45af0. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:19:13 user nova-compute[71692]: DEBUG nova.network.neutron [req-4654a459-2373-48a4-8627-e0eb4987bc7c req-464f9e33-6d42-4503-af78-903cf9e4fcf8 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Updating instance_info_cache with network_info: [{"id": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "address": "fa:16:3e:8e:c2:1f", "network": {"id": "f73b1428-f00d-4eeb-91eb-d5c99ee34946", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-533041060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b7cc9c0ba145bea0585e887a92c788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa29956b4-c9", "ovs_interfaceid": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:19:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4654a459-2373-48a4-8627-e0eb4987bc7c req-464f9e33-6d42-4503-af78-903cf9e4fcf8 service nova] Releasing lock "refresh_cache-080204b2-fd4d-4224-b391-a27036d058ac" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:15 user nova-compute[71692]: INFO nova.compute.manager [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Terminating instance
Apr 13 19:19:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-dd3f260b-12db-42a3-9612-f8ddccac0770 req-05287e20-c8cc-419f-8de9-e688a71620e0 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Received event network-vif-unplugged-a29956b4-c9c2-4c86-bf4a-488fb5f45af0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dd3f260b-12db-42a3-9612-f8ddccac0770 req-05287e20-c8cc-419f-8de9-e688a71620e0 service nova] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dd3f260b-12db-42a3-9612-f8ddccac0770 req-05287e20-c8cc-419f-8de9-e688a71620e0 service nova] Lock "080204b2-fd4d-4224-b391-a27036d058ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dd3f260b-12db-42a3-9612-f8ddccac0770 req-05287e20-c8cc-419f-8de9-e688a71620e0 service nova] Lock "080204b2-fd4d-4224-b391-a27036d058ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-dd3f260b-12db-42a3-9612-f8ddccac0770 req-05287e20-c8cc-419f-8de9-e688a71620e0 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] No waiting events found dispatching network-vif-unplugged-a29956b4-c9c2-4c86-bf4a-488fb5f45af0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-dd3f260b-12db-42a3-9612-f8ddccac0770 req-05287e20-c8cc-419f-8de9-e688a71620e0 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Received event network-vif-unplugged-a29956b4-c9c2-4c86-bf4a-488fb5f45af0 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:15 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Instance destroyed successfully.
Apr 13 19:19:15 user nova-compute[71692]: DEBUG nova.objects.instance [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lazy-loading 'resources' on Instance uuid 080204b2-fd4d-4224-b391-a27036d058ac {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:12:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-56826252',display_name='tempest-SnapshotDataIntegrityTests-server-56826252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-56826252',id=27,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxycQUgxgvX4KrgSogh/FASMjBbt5FoL1Bm1OSdfsr2+D71mN0wUg1CoONDh6D08fd9G3ZLcmygPYoHkYKYM7UcbNhGrJakuHGCpIrB6MuMLJflBJ0+myyAMtN9XEOSGg==',key_name='tempest-SnapshotDataIntegrityTests-1182290909',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:13:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0b7cc9c0ba145bea0585e887a92c788',ramdisk_id='',reservation_id='r-8lp2gpxm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-679043734',owner_user_name='tempest-SnapshotDataIntegrityTests-679043734-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:13:01Z,user_data=None,user_id='60dea69daeb2475f84b5a46821288be9',uuid=080204b2-fd4d-4224-b391-a27036d058ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "address": "fa:16:3e:8e:c2:1f", "network": {"id": "f73b1428-f00d-4eeb-91eb-d5c99ee34946", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-533041060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b7cc9c0ba145bea0585e887a92c788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa29956b4-c9", "ovs_interfaceid": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Converting VIF {"id": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "address": "fa:16:3e:8e:c2:1f", "network": {"id": "f73b1428-f00d-4eeb-91eb-d5c99ee34946", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-533041060-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0b7cc9c0ba145bea0585e887a92c788", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa29956b4-c9", "ovs_interfaceid": "a29956b4-c9c2-4c86-bf4a-488fb5f45af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:c2:1f,bridge_name='br-int',has_traffic_filtering=True,id=a29956b4-c9c2-4c86-bf4a-488fb5f45af0,network=Network(f73b1428-f00d-4eeb-91eb-d5c99ee34946),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa29956b4-c9') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG os_vif [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:c2:1f,bridge_name='br-int',has_traffic_filtering=True,id=a29956b4-c9c2-4c86-bf4a-488fb5f45af0,network=Network(f73b1428-f00d-4eeb-91eb-d5c99ee34946),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa29956b4-c9') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa29956b4-c9, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:19:15 user nova-compute[71692]: INFO os_vif [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:c2:1f,bridge_name='br-int',has_traffic_filtering=True,id=a29956b4-c9c2-4c86-bf4a-488fb5f45af0,network=Network(f73b1428-f00d-4eeb-91eb-d5c99ee34946),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa29956b4-c9')
Apr 13 19:19:15 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Deleting instance files /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac_del
Apr 13 19:19:15 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Deletion of /opt/stack/data/nova/instances/080204b2-fd4d-4224-b391-a27036d058ac_del complete
Apr 13 19:19:15 user nova-compute[71692]: INFO nova.compute.manager [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 13 19:19:15 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:19:15 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413540.915132, 166341f7-a5fa-4034-8281-6aed0be1bd5a => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:19:15 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] VM Stopped (Lifecycle Event)
Apr 13 19:19:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b905de02-b3d4-49cd-8454-7f5674966f6f None None] [instance: 166341f7-a5fa-4034-8281-6aed0be1bd5a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:19:16 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:19:16 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Took 0.45 seconds to deallocate network for instance.
Apr 13 19:19:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-c5d71e59-1aa4-44c5-be8d-2a29ee545fe3 req-fabe78a0-b216-455b-ae6a-39b31ca2bb60 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Received event network-vif-deleted-a29956b4-c9c2-4c86-bf4a-488fb5f45af0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:16 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:19:16 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:19:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:16 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Deleted allocations for instance 080204b2-fd4d-4224-b391-a27036d058ac
Apr 13 19:19:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-ecf3db8b-8af3-4c58-9c33-00b8f21944ac tempest-SnapshotDataIntegrityTests-679043734 tempest-SnapshotDataIntegrityTests-679043734-project-member] Lock "080204b2-fd4d-4224-b391-a27036d058ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.683s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-28c2f8a1-e021-4fc5-aa49-6b884afdfe39 req-0afe0b4d-a5ad-42d6-9eb2-f04470c233f3 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Received event network-vif-plugged-a29956b4-c9c2-4c86-bf4a-488fb5f45af0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-28c2f8a1-e021-4fc5-aa49-6b884afdfe39 req-0afe0b4d-a5ad-42d6-9eb2-f04470c233f3 service nova] Acquiring lock "080204b2-fd4d-4224-b391-a27036d058ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-28c2f8a1-e021-4fc5-aa49-6b884afdfe39 req-0afe0b4d-a5ad-42d6-9eb2-f04470c233f3 service nova] Lock "080204b2-fd4d-4224-b391-a27036d058ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-28c2f8a1-e021-4fc5-aa49-6b884afdfe39 req-0afe0b4d-a5ad-42d6-9eb2-f04470c233f3 service nova] Lock "080204b2-fd4d-4224-b391-a27036d058ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-28c2f8a1-e021-4fc5-aa49-6b884afdfe39 req-0afe0b4d-a5ad-42d6-9eb2-f04470c233f3 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] No waiting events found dispatching network-vif-plugged-a29956b4-c9c2-4c86-bf4a-488fb5f45af0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:19:17 user nova-compute[71692]: WARNING nova.compute.manager [req-28c2f8a1-e021-4fc5-aa49-6b884afdfe39 req-0afe0b4d-a5ad-42d6-9eb2-f04470c233f3 service nova] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Received unexpected event network-vif-plugged-a29956b4-c9c2-4c86-bf4a-488fb5f45af0 for instance with vm_state deleted and task_state None.
Apr 13 19:19:19 user nova-compute[71692]: DEBUG nova.compute.manager [req-3adf4fc4-a47b-41ac-a2ce-66a861632946 req-3c8a835f-6024-4c02-a42c-257b85765ffb service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received event network-changed-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:19 user nova-compute[71692]: DEBUG nova.compute.manager [req-3adf4fc4-a47b-41ac-a2ce-66a861632946 req-3c8a835f-6024-4c02-a42c-257b85765ffb service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Refreshing instance network info cache due to event network-changed-96f25cc6-1d0b-467a-be3e-a312cd09fbdf. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:19:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3adf4fc4-a47b-41ac-a2ce-66a861632946 req-3c8a835f-6024-4c02-a42c-257b85765ffb service nova] Acquiring lock "refresh_cache-620bc9c9-26a0-461f-8771-418b3e9aea79" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:19:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3adf4fc4-a47b-41ac-a2ce-66a861632946 req-3c8a835f-6024-4c02-a42c-257b85765ffb service nova] Acquired lock "refresh_cache-620bc9c9-26a0-461f-8771-418b3e9aea79" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:19:19 user nova-compute[71692]: DEBUG nova.network.neutron [req-3adf4fc4-a47b-41ac-a2ce-66a861632946 req-3c8a835f-6024-4c02-a42c-257b85765ffb service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Refreshing network info cache for port 96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:19:20 user nova-compute[71692]: DEBUG nova.network.neutron [req-3adf4fc4-a47b-41ac-a2ce-66a861632946 req-3c8a835f-6024-4c02-a42c-257b85765ffb service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Updated VIF entry in instance network info cache for port 96f25cc6-1d0b-467a-be3e-a312cd09fbdf. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:19:20 user nova-compute[71692]: DEBUG nova.network.neutron [req-3adf4fc4-a47b-41ac-a2ce-66a861632946 req-3c8a835f-6024-4c02-a42c-257b85765ffb service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Updating instance_info_cache with network_info: [{"id": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "address": "fa:16:3e:a6:27:19", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f25cc6-1d", "ovs_interfaceid": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:19:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3adf4fc4-a47b-41ac-a2ce-66a861632946 req-3c8a835f-6024-4c02-a42c-257b85765ffb service nova] Releasing lock "refresh_cache-620bc9c9-26a0-461f-8771-418b3e9aea79" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:19:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "620bc9c9-26a0-461f-8771-418b3e9aea79" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG nova.objects.instance [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'flavor' on Instance uuid 620bc9c9-26a0-461f-8771-418b3e9aea79 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "620bc9c9-26a0-461f-8771-418b3e9aea79" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:21 user nova-compute[71692]: INFO nova.compute.manager [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Attaching volume 594cd591-f422-47d5-bcc8-1a73383abd82 to /dev/vdb
Apr 13 19:19:21 user nova-compute[71692]: DEBUG os_brick.utils [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7071ef-53c7-42b9-bb73-7f63cb1cdd7c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa2e9bf-559c-47f8-8245-aa33b60968ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c45cd7f-ab79-4750-bde9-fef3df1b7a40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a57e148-4e4f-4a25-9485-d2d449c9015b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:19:21 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:19:21 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9a9eb6-c13e-47bd-92b7-c413de4c241b]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG os_brick.utils [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Updating existing volume attachment record: 0586ff41-a06e-44df-be5b-da84fd2c23ce {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:19:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFkilLuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:19:25 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:19:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:19:25 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:19:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:19:25 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de67e96-5e06-4a7e-b0a9-92dda1398051]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:19:25 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d16d004-da39-4289-b046-a2337aae489a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82] added
Apr 13 19:19:25 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ebb428-57a4-4ae4-95eb-ef124d816bdd]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce616d0-056d-46bc-b532-0f2930cd0a7b]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gFkilLuc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gFkilLuc" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7780208-31dc-4853-8986-eaf6cbae7e7f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gFkilLuc'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a8d342-7a7e-4207-9537-b35d51ddea87]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dab91aa-a65d-45f7-9cd5-5ac4444f15b2]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:19:25 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:19:25 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:19:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3a4146-9dc4-416a-9e71-519d6926bd66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82, portal: 172.16.0.220,3260]
Apr 13 19:19:26 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82, portal: 172.16.0.220,3260] successful.
Apr 13 19:19:26 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d466c3b7-fdb6-41ca-9fc5-35d4ede30cdf]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bf1e18-a525-4a8e-856f-d108ec962ca0]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:19:26 user nova-compute[71692]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 (non-flash)
Apr 13 19:19:26 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:19:26 user nova-compute[71692]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 (non-flash)
Apr 13 19:19:26 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[674f8415-428d-4964-a85f-6bccca2c505d]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:19:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:27 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:19:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFkilLuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:19:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:19:27 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23838383033373037', 'path': '/dev/sdc'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:19:27 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838383033373037', 'path': '/dev/sdc'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:19:27 user nova-compute[71692]: DEBUG nova.objects.instance [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'flavor' on Instance uuid 620bc9c9-26a0-461f-8771-418b3e9aea79 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:19:27 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:19:27 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:19:27 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:19:27 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:19:27 user nova-compute[71692]:   <serial>594cd591-f422-47d5-bcc8-1a73383abd82</serial>
Apr 13 19:19:27 user nova-compute[71692]: </disk>
Apr 13 19:19:27 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:19:27 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:19:27 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:19:27 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] No VIF found with MAC fa:16:3e:a6:27:19, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:19:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d621aecf-7a43-46bf-bc43-fd881861778f tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.649s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "620bc9c9-26a0-461f-8771-418b3e9aea79" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:29 user nova-compute[71692]: INFO nova.compute.manager [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Detaching volume 594cd591-f422-47d5-bcc8-1a73383abd82
Apr 13 19:19:29 user nova-compute[71692]: INFO nova.virt.block_device [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Attempting to driver detach volume 594cd591-f422-47d5-bcc8-1a73383abd82 from mountpoint /dev/vdb
Apr 13 19:19:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Attempting to detach device vdb from instance 620bc9c9-26a0-461f-8771-418b3e9aea79 from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:19:29 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:19:29 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:19:29 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:19:29 user nova-compute[71692]:   <serial>594cd591-f422-47d5-bcc8-1a73383abd82</serial>
Apr 13 19:19:29 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:19:29 user nova-compute[71692]: </disk>
Apr 13 19:19:29 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:19:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Successfully detached device vdb from instance 620bc9c9-26a0-461f-8771-418b3e9aea79 from the persistent domain config.
Apr 13 19:19:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 620bc9c9-26a0-461f-8771-418b3e9aea79 from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:19:29 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:19:29 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:19:29 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:19:29 user nova-compute[71692]:   <serial>594cd591-f422-47d5-bcc8-1a73383abd82</serial>
Apr 13 19:19:29 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:19:29 user nova-compute[71692]: </disk>
Apr 13 19:19:29 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681413569.7314677, 620bc9c9-26a0-461f-8771-418b3e9aea79 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 620bc9c9-26a0-461f-8771-418b3e9aea79 {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:19:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Successfully detached device vdb from instance 620bc9c9-26a0-461f-8771-418b3e9aea79 from the live domain config.
Apr 13 19:19:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFkilLuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:19:29 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:19:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1c19cd-289c-4b12-9627-9c7dc2a7eb64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:19:29 user nova-compute[71692]: No targets found.
Apr 13 19:19:29 user nova-compute[71692]: iSNS:
Apr 13 19:19:29 user nova-compute[71692]: No targets found.
Apr 13 19:19:29 user nova-compute[71692]: STATIC:
Apr 13 19:19:29 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82
Apr 13 19:19:29 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:19:29 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:19:29 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2
Apr 13 19:19:29 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:19:29 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:19:29 user nova-compute[71692]: FIRMWARE:
Apr 13 19:19:29 user nova-compute[71692]: No targets found.
Apr 13 19:19:29 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:19:29 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:19:29 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb155b0-6321-4ff8-af33-9128a5f8cfa2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b30dee2-3266-43b5-ad42-b9e31f14d9f4]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:19:29 user nova-compute[71692]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 (non-flash)
Apr 13 19:19:29 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:19:29 user nova-compute[71692]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 (non-flash)
Apr 13 19:19:29 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febc41da8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82'): ({'sdc'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Removing single pathed devices sdc {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[755521aa-1110-433e-9f55-e87bc48b33d2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaf79a2-f40e-4058-9bfa-32dab8e1f68a]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flushing IO for device /dev/sdc {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[da024487-765e-4c64-8997-f79f16f18662]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d110d390-17af-4a8f-a188-5e56d1d7f643]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae876a15-7c09-445f-90d5-81919355b29c]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:19:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3696e3f-649d-4329-b216-61b25105a466]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82, portal: 172.16.0.220,3260]
Apr 13 19:19:30 user nova-compute[71692]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82, portal: 172.16.0.220,3260] successful.
Apr 13 19:19:30 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:19:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594cd591-f422-47d5-bcc8-1a73383abd82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb6aa8d-97b7-4471-aab1-7f4292d66ecd]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:19:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:19:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] <== disconnect_volume: return (300ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:19:30 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:19:30 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413555.8161604, 080204b2-fd4d-4224-b391-a27036d058ac => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:19:30 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] VM Stopped (Lifecycle Event)
Apr 13 19:19:30 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b43c3fb3-ad22-42b2-834a-c9ed02285b80 None None] [instance: 080204b2-fd4d-4224-b391-a27036d058ac] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:19:30 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:31 user nova-compute[71692]: DEBUG nova.objects.instance [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'flavor' on Instance uuid 620bc9c9-26a0-461f-8771-418b3e9aea79 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:19:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-37267c70-6b79-40eb-84c3-7c25301b78ed tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.773s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "a9f3d080-a163-4897-9187-2687cae49694" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:38 user nova-compute[71692]: INFO nova.compute.manager [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Terminating instance
Apr 13 19:19:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:19:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:38 user nova-compute[71692]: DEBUG nova.compute.manager [req-51fa103d-0d31-43fb-83b1-8034f8b0f17b req-0847c7c4-c2d6-43bc-af61-29c5c01f7a9b service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received event network-vif-unplugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-51fa103d-0d31-43fb-83b1-8034f8b0f17b req-0847c7c4-c2d6-43bc-af61-29c5c01f7a9b service nova] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-51fa103d-0d31-43fb-83b1-8034f8b0f17b req-0847c7c4-c2d6-43bc-af61-29c5c01f7a9b service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-51fa103d-0d31-43fb-83b1-8034f8b0f17b req-0847c7c4-c2d6-43bc-af61-29c5c01f7a9b service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:38 user nova-compute[71692]: DEBUG nova.compute.manager [req-51fa103d-0d31-43fb-83b1-8034f8b0f17b req-0847c7c4-c2d6-43bc-af61-29c5c01f7a9b service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] No waiting events found dispatching network-vif-unplugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:19:38 user nova-compute[71692]: DEBUG nova.compute.manager [req-51fa103d-0d31-43fb-83b1-8034f8b0f17b req-0847c7c4-c2d6-43bc-af61-29c5c01f7a9b service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received event network-vif-unplugged-2207b77c-fc08-471c-8281-cd1f6061ea54 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:39 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: a9f3d080-a163-4897-9187-2687cae49694] Instance destroyed successfully.
Apr 13 19:19:39 user nova-compute[71692]: DEBUG nova.objects.instance [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'resources' on Instance uuid a9f3d080-a163-4897-9187-2687cae49694 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:13:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1898726378',display_name='tempest-ServerActionsTestJSON-server-1898726378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1898726378',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:15:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-z4fn11mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=a9f3d080-a163-4897-9187-2687cae49694,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "2207b77c-fc08-471c-8281-cd1f6061ea54", "address": "fa:16:3e:7b:c7:2f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2207b77c-fc", "ovs_interfaceid": "2207b77c-fc08-471c-8281-cd1f6061ea54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=2207b77c-fc08-471c-8281-cd1f6061ea54,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2207b77c-fc') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_vif [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=2207b77c-fc08-471c-8281-cd1f6061ea54,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2207b77c-fc') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2207b77c-fc, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:19:39 user nova-compute[71692]: INFO os_vif [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:c7:2f,bridge_name='br-int',has_traffic_filtering=True,id=2207b77c-fc08-471c-8281-cd1f6061ea54,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2207b77c-fc')
Apr 13 19:19:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UTPAhqcO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:19:39 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[461eaa9b-787f-4450-9d55-b880b60cd5fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:19:39 user nova-compute[71692]: No targets found.
Apr 13 19:19:39 user nova-compute[71692]: iSNS:
Apr 13 19:19:39 user nova-compute[71692]: No targets found.
Apr 13 19:19:39 user nova-compute[71692]: STATIC:
Apr 13 19:19:39 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2
Apr 13 19:19:39 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:19:39 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:19:39 user nova-compute[71692]: FIRMWARE:
Apr 13 19:19:39 user nova-compute[71692]: No targets found.
Apr 13 19:19:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:19:39 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:19:39 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bca29d-f4d7-4864-9d78-52cf608da132]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fdbc5e-c8e3-47d7-8a0d-7d3c518744dc]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:19:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 (non-flash)
Apr 13 19:19:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febc41d9b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2'): ({'sdb'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Removing single pathed devices sdb {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b752a4-406d-48a0-85ce-ff17c238e24c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13ac5d8-53ec-40ec-8525-d28663d2e4aa]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Flushing IO for device /dev/sdb {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d23cd55-cc54-4770-9d56-4a1fd379b592]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[099be6ea-dcf2-476c-9499-fd1c09467e67]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e848fcb1-7874-422b-8db1-226a61123add]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd71c47-97cb-4165-831b-112c16e7dd47]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2, portal: 172.16.0.220,3260]
Apr 13 19:19:39 user nova-compute[71692]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2, portal: 172.16.0.220,3260] successful.
Apr 13 19:19:39 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7cde3ec4-f279-44f2-927c-45ce0d350ca2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f936cd-9945-4929-8171-ef5f23eea4a1]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] <== disconnect_volume: return (336ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:19:39 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Deleting instance files /opt/stack/data/nova/instances/a9f3d080-a163-4897-9187-2687cae49694_del
Apr 13 19:19:39 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Deletion of /opt/stack/data/nova/instances/a9f3d080-a163-4897-9187-2687cae49694_del complete
Apr 13 19:19:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:39 user nova-compute[71692]: INFO nova.compute.manager [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 13 19:19:39 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: a9f3d080-a163-4897-9187-2687cae49694] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:19:39 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: a9f3d080-a163-4897-9187-2687cae49694] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:19:40 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: a9f3d080-a163-4897-9187-2687cae49694] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:19:40 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: a9f3d080-a163-4897-9187-2687cae49694] Took 1.02 seconds to deallocate network for instance.
Apr 13 19:19:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-5a111595-b78d-48fb-8481-666e7a26ba22 req-6c6ae53a-9e67-41f1-9ebd-165c003f5ecf service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received event network-vif-deleted-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:40 user nova-compute[71692]: INFO nova.compute.manager [req-5a111595-b78d-48fb-8481-666e7a26ba22 req-6c6ae53a-9e67-41f1-9ebd-165c003f5ecf service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Neutron deleted interface 2207b77c-fc08-471c-8281-cd1f6061ea54; detaching it from the instance and deleting it from the info cache
Apr 13 19:19:40 user nova-compute[71692]: DEBUG nova.network.neutron [req-5a111595-b78d-48fb-8481-666e7a26ba22 req-6c6ae53a-9e67-41f1-9ebd-165c003f5ecf service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:19:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-5a111595-b78d-48fb-8481-666e7a26ba22 req-6c6ae53a-9e67-41f1-9ebd-165c003f5ecf service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Detach interface failed, port_id=2207b77c-fc08-471c-8281-cd1f6061ea54, reason: Instance a9f3d080-a163-4897-9187-2687cae49694 could not be found. {{(pid=71692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] No waiting events found dispatching network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:19:41 user nova-compute[71692]: WARNING nova.compute.manager [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received unexpected event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 for instance with vm_state active and task_state deleting.
Apr 13 19:19:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] No waiting events found dispatching network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:19:41 user nova-compute[71692]: WARNING nova.compute.manager [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received unexpected event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 for instance with vm_state active and task_state deleting.
Apr 13 19:19:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] No waiting events found dispatching network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:19:41 user nova-compute[71692]: WARNING nova.compute.manager [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received unexpected event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 for instance with vm_state active and task_state deleting.
Apr 13 19:19:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received event network-vif-unplugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] No waiting events found dispatching network-vif-unplugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received event network-vif-unplugged-2207b77c-fc08-471c-8281-cd1f6061ea54 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Acquiring lock "a9f3d080-a163-4897-9187-2687cae49694-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] Lock "a9f3d080-a163-4897-9187-2687cae49694-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] No waiting events found dispatching network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:19:41 user nova-compute[71692]: WARNING nova.compute.manager [req-515b7d13-52f6-4ba2-bf6b-aaf12ddb3519 req-f5916374-f861-440a-8ee0-109de3d06918 service nova] [instance: a9f3d080-a163-4897-9187-2687cae49694] Received unexpected event network-vif-plugged-2207b77c-fc08-471c-8281-cd1f6061ea54 for instance with vm_state active and task_state deleting.
Apr 13 19:19:41 user nova-compute[71692]: INFO nova.compute.manager [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Took 0.77 seconds to detach 1 volumes for instance.
Apr 13 19:19:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: a9f3d080-a163-4897-9187-2687cae49694] Deleting volume: 7cde3ec4-f279-44f2-927c-45ce0d350ca2 {{(pid=71692) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:42 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:19:42 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:19:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:42 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Deleted allocations for instance a9f3d080-a163-4897-9187-2687cae49694
Apr 13 19:19:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-449bd45f-bb34-4a2a-81f1-78473c0d4a2a tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "a9f3d080-a163-4897-9187-2687cae49694" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.474s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:43 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:19:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:46 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:19:46 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:19:47 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "59d7b86a-c723-4255-827e-2f6a641239df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "59d7b86a-c723-4255-827e-2f6a641239df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "59d7b86a-c723-4255-827e-2f6a641239df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:49 user nova-compute[71692]: INFO nova.compute.manager [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Terminating instance
Apr 13 19:19:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Skipping network cache update for instance because it is being deleted. {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9841}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG nova.compute.manager [req-6485638f-c730-454b-81f1-7cc6e491e841 req-b3ecc6af-2a47-4869-83f4-631b3740a0a8 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received event network-vif-unplugged-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6485638f-c730-454b-81f1-7cc6e491e841 req-b3ecc6af-2a47-4869-83f4-631b3740a0a8 service nova] Acquiring lock "59d7b86a-c723-4255-827e-2f6a641239df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6485638f-c730-454b-81f1-7cc6e491e841 req-b3ecc6af-2a47-4869-83f4-631b3740a0a8 service nova] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6485638f-c730-454b-81f1-7cc6e491e841 req-b3ecc6af-2a47-4869-83f4-631b3740a0a8 service nova] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG nova.compute.manager [req-6485638f-c730-454b-81f1-7cc6e491e841 req-b3ecc6af-2a47-4869-83f4-631b3740a0a8 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] No waiting events found dispatching network-vif-unplugged-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG nova.compute.manager [req-6485638f-c730-454b-81f1-7cc6e491e841 req-b3ecc6af-2a47-4869-83f4-631b3740a0a8 service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received event network-vif-unplugged-3de4b459-2a9f-4570-80b1-dce61f40a377 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Updating instance_info_cache with network_info: [{"id": "ab959649-556a-479c-9e13-ec36fb9ebb66", "address": "fa:16:3e:4b:6d:5f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab959649-55", "ovs_interfaceid": "ab959649-556a-479c-9e13-ec36fb9ebb66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-579c83e7-7976-47f4-9f25-a194e39966ba" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:19:49 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Instance destroyed successfully.
Apr 13 19:19:49 user nova-compute[71692]: DEBUG nova.objects.instance [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'resources' on Instance uuid 59d7b86a-c723-4255-827e-2f6a641239df {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:03:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1333783847',display_name='tempest-ServerRescueNegativeTestJSON-server-1333783847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1333783847',id=15,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:05:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42fbd7089a7e4ba8b2597fca0d8e84c8',ramdisk_id='',reservation_id='r-4fmtejoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1255770111',owner_user_name='tempest-ServerRescueNegativeTestJSON-1255770111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:05:48Z,user_data=None,user_id='3bebf61a7401492692f9c60adde178f7',uuid=59d7b86a-c723-4255-827e-2f6a641239df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "3de4b459-2a9f-4570-80b1-dce61f40a377", "address": "fa:16:3e:de:c1:80", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4b459-2a", "ovs_interfaceid": "3de4b459-2a9f-4570-80b1-dce61f40a377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converting VIF {"id": "3de4b459-2a9f-4570-80b1-dce61f40a377", "address": "fa:16:3e:de:c1:80", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4b459-2a", "ovs_interfaceid": "3de4b459-2a9f-4570-80b1-dce61f40a377", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:c1:80,bridge_name='br-int',has_traffic_filtering=True,id=3de4b459-2a9f-4570-80b1-dce61f40a377,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4b459-2a') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG os_vif [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:c1:80,bridge_name='br-int',has_traffic_filtering=True,id=3de4b459-2a9f-4570-80b1-dce61f40a377,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4b459-2a') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3de4b459-2a, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:19:49 user nova-compute[71692]: INFO os_vif [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:c1:80,bridge_name='br-int',has_traffic_filtering=True,id=3de4b459-2a9f-4570-80b1-dce61f40a377,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4b459-2a')
Apr 13 19:19:49 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Deleting instance files /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df_del
Apr 13 19:19:49 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Deletion of /opt/stack/data/nova/instances/59d7b86a-c723-4255-827e-2f6a641239df_del complete
Apr 13 19:19:49 user nova-compute[71692]: INFO nova.compute.manager [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 13 19:19:49 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:19:49 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:19:50 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Took 0.47 seconds to deallocate network for instance.
Apr 13 19:19:50 user nova-compute[71692]: DEBUG nova.compute.manager [req-6d7ea0fa-7e49-4d47-858e-f8280abde990 req-075af2a6-fae8-4008-967c-5bedbf6bc2df service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received event network-vif-deleted-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:50 user nova-compute[71692]: INFO nova.compute.manager [req-6d7ea0fa-7e49-4d47-858e-f8280abde990 req-075af2a6-fae8-4008-967c-5bedbf6bc2df service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Neutron deleted interface 3de4b459-2a9f-4570-80b1-dce61f40a377; detaching it from the instance and deleting it from the info cache
Apr 13 19:19:50 user nova-compute[71692]: DEBUG nova.network.neutron [req-6d7ea0fa-7e49-4d47-858e-f8280abde990 req-075af2a6-fae8-4008-967c-5bedbf6bc2df service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG nova.compute.manager [req-6d7ea0fa-7e49-4d47-858e-f8280abde990 req-075af2a6-fae8-4008-967c-5bedbf6bc2df service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Detach interface failed, port_id=3de4b459-2a9f-4570-80b1-dce61f40a377, reason: Instance 59d7b86a-c723-4255-827e-2f6a641239df could not be found. {{(pid=71692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:50 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Deleted allocations for instance 59d7b86a-c723-4255-827e-2f6a641239df
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9eb8ff11-6e92-49bf-8ef2-c4aa5e7013c3 tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "59d7b86a-c723-4255-827e-2f6a641239df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.789s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG nova.compute.manager [req-737b3246-b2f1-4f7c-98d1-e4ef849e569f req-5d2edb9f-6b5b-4bdf-bd6d-162a9337a85c service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received event network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-737b3246-b2f1-4f7c-98d1-e4ef849e569f req-5d2edb9f-6b5b-4bdf-bd6d-162a9337a85c service nova] Acquiring lock "59d7b86a-c723-4255-827e-2f6a641239df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-737b3246-b2f1-4f7c-98d1-e4ef849e569f req-5d2edb9f-6b5b-4bdf-bd6d-162a9337a85c service nova] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-737b3246-b2f1-4f7c-98d1-e4ef849e569f req-5d2edb9f-6b5b-4bdf-bd6d-162a9337a85c service nova] Lock "59d7b86a-c723-4255-827e-2f6a641239df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG nova.compute.manager [req-737b3246-b2f1-4f7c-98d1-e4ef849e569f req-5d2edb9f-6b5b-4bdf-bd6d-162a9337a85c service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] No waiting events found dispatching network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:19:51 user nova-compute[71692]: WARNING nova.compute.manager [req-737b3246-b2f1-4f7c-98d1-e4ef849e569f req-5d2edb9f-6b5b-4bdf-bd6d-162a9337a85c service nova] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Received unexpected event network-vif-plugged-3de4b459-2a9f-4570-80b1-dce61f40a377 for instance with vm_state deleted and task_state None.
Apr 13 19:19:51 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:19:51 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:19:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8459MB free_disk=26.13983154296875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 579c83e7-7976-47f4-9f25-a194e39966ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 620bc9c9-26a0-461f-8771-418b3e9aea79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:19:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:53 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:19:54 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413579.4448972, a9f3d080-a163-4897-9187-2687cae49694 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:19:54 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: a9f3d080-a163-4897-9187-2687cae49694] VM Stopped (Lifecycle Event)
Apr 13 19:19:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-33811fee-d534-460c-8ebd-a01610a3e66a None None] [instance: a9f3d080-a163-4897-9187-2687cae49694] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:19:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "3b98531d-34ae-4f83-930a-3c970727fac8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "3b98531d-34ae-4f83-930a-3c970727fac8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:58 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:19:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:58 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:19:58 user nova-compute[71692]: INFO nova.compute.claims [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Claim successful on node user
Apr 13 19:19:59 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:19:59 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:19:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG nova.policy [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '789fdd98ede74e6783b667178c2689fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '024f13d8c179482791ed1545b6b2efd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:19:59 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Creating image(s)
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "/opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "/opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.130s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk 1073741824" returned: 0 in 0.047s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Successfully created port: 83ef4caf-d717-4e45-9511-cfcc225f7b05 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Cannot resize image /opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG nova.objects.instance [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lazy-loading 'migration_context' on Instance uuid 3b98531d-34ae-4f83-930a-3c970727fac8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Ensure instance console log exists: /opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:19:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.network.neutron [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Successfully updated port: 83ef4caf-d717-4e45-9511-cfcc225f7b05 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "refresh_cache-3b98531d-34ae-4f83-930a-3c970727fac8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquired lock "refresh_cache-3b98531d-34ae-4f83-930a-3c970727fac8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.network.neutron [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-e840df87-8ec1-483c-9c1b-07dd4948c19a req-57a9e401-06ed-45dc-b904-4fef52c00d6c service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Received event network-changed-83ef4caf-d717-4e45-9511-cfcc225f7b05 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-e840df87-8ec1-483c-9c1b-07dd4948c19a req-57a9e401-06ed-45dc-b904-4fef52c00d6c service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Refreshing instance network info cache due to event network-changed-83ef4caf-d717-4e45-9511-cfcc225f7b05. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e840df87-8ec1-483c-9c1b-07dd4948c19a req-57a9e401-06ed-45dc-b904-4fef52c00d6c service nova] Acquiring lock "refresh_cache-3b98531d-34ae-4f83-930a-3c970727fac8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.network.neutron [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.network.neutron [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Updating instance_info_cache with network_info: [{"id": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "address": "fa:16:3e:3e:a3:90", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ef4caf-d7", "ovs_interfaceid": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Releasing lock "refresh_cache-3b98531d-34ae-4f83-930a-3c970727fac8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Instance network_info: |[{"id": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "address": "fa:16:3e:3e:a3:90", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ef4caf-d7", "ovs_interfaceid": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e840df87-8ec1-483c-9c1b-07dd4948c19a req-57a9e401-06ed-45dc-b904-4fef52c00d6c service nova] Acquired lock "refresh_cache-3b98531d-34ae-4f83-930a-3c970727fac8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.network.neutron [req-e840df87-8ec1-483c-9c1b-07dd4948c19a req-57a9e401-06ed-45dc-b904-4fef52c00d6c service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Refreshing network info cache for port 83ef4caf-d717-4e45-9511-cfcc225f7b05 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Start _get_guest_xml network_info=[{"id": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "address": "fa:16:3e:3e:a3:90", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ef4caf-d7", "ovs_interfaceid": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:20:00 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:20:00 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:19:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-609609545',display_name='tempest-VolumesSnapshotTestJSON-instance-609609545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-609609545',id=33,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='024f13d8c179482791ed1545b6b2efd8',ramdisk_id='',reservation_id='r-tcjup60b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-613917248',owner_user_name='tempest-VolumesSnapshotTestJSON-613917248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:19:59Z,user_data=None,user_id='789fdd98ede74e6783b667178c2689fb',uuid=3b98531d-34ae-4f83-930a-3c970727fac8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "address": "fa:16:3e:3e:a3:90", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ef4caf-d7", "ovs_interfaceid": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Converting VIF {"id": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "address": "fa:16:3e:3e:a3:90", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ef4caf-d7", "ovs_interfaceid": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a3:90,bridge_name='br-int',has_traffic_filtering=True,id=83ef4caf-d717-4e45-9511-cfcc225f7b05,network=Network(0e855c73-cf7d-4c09-9fb5-3a4a7903b519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83ef4caf-d7') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.objects.instance [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b98531d-34ae-4f83-930a-3c970727fac8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:20:00 user nova-compute[71692]:   <uuid>3b98531d-34ae-4f83-930a-3c970727fac8</uuid>
Apr 13 19:20:00 user nova-compute[71692]:   <name>instance-00000021</name>
Apr 13 19:20:00 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:20:00 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:20:00 user nova-compute[71692]:   <metadata>
Apr 13 19:20:00 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:20:00 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:20:00 user nova-compute[71692]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-609609545</nova:name>
Apr 13 19:20:00 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:20:00</nova:creationTime>
Apr 13 19:20:00 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:20:00 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:20:00 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:20:00 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:20:00 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:20:00 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:20:00 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:20:00 user nova-compute[71692]:       <nova:owner>
Apr 13 19:20:00 user nova-compute[71692]:         <nova:user uuid="789fdd98ede74e6783b667178c2689fb">tempest-VolumesSnapshotTestJSON-613917248-project-member</nova:user>
Apr 13 19:20:00 user nova-compute[71692]:         <nova:project uuid="024f13d8c179482791ed1545b6b2efd8">tempest-VolumesSnapshotTestJSON-613917248</nova:project>
Apr 13 19:20:00 user nova-compute[71692]:       </nova:owner>
Apr 13 19:20:00 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:20:00 user nova-compute[71692]:       <nova:ports>
Apr 13 19:20:00 user nova-compute[71692]:         <nova:port uuid="83ef4caf-d717-4e45-9511-cfcc225f7b05">
Apr 13 19:20:00 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 19:20:00 user nova-compute[71692]:         </nova:port>
Apr 13 19:20:00 user nova-compute[71692]:       </nova:ports>
Apr 13 19:20:00 user nova-compute[71692]:     </nova:instance>
Apr 13 19:20:00 user nova-compute[71692]:   </metadata>
Apr 13 19:20:00 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:20:00 user nova-compute[71692]:     <system>
Apr 13 19:20:00 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:20:00 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:20:00 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:20:00 user nova-compute[71692]:       <entry name="serial">3b98531d-34ae-4f83-930a-3c970727fac8</entry>
Apr 13 19:20:00 user nova-compute[71692]:       <entry name="uuid">3b98531d-34ae-4f83-930a-3c970727fac8</entry>
Apr 13 19:20:00 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:20:00 user nova-compute[71692]:     </system>
Apr 13 19:20:00 user nova-compute[71692]:   </sysinfo>
Apr 13 19:20:00 user nova-compute[71692]:   <os>
Apr 13 19:20:00 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:20:00 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:20:00 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:20:00 user nova-compute[71692]:   </os>
Apr 13 19:20:00 user nova-compute[71692]:   <features>
Apr 13 19:20:00 user nova-compute[71692]:     <acpi/>
Apr 13 19:20:00 user nova-compute[71692]:     <apic/>
Apr 13 19:20:00 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:20:00 user nova-compute[71692]:   </features>
Apr 13 19:20:00 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:20:00 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:20:00 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:20:00 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:20:00 user nova-compute[71692]:   </clock>
Apr 13 19:20:00 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:20:00 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:20:00 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:20:00 user nova-compute[71692]:   </cpu>
Apr 13 19:20:00 user nova-compute[71692]:   <devices>
Apr 13 19:20:00 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:20:00 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:20:00 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk"/>
Apr 13 19:20:00 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:20:00 user nova-compute[71692]:     </disk>
Apr 13 19:20:00 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:20:00 user nova-compute[71692]:       <mac address="fa:16:3e:3e:a3:90"/>
Apr 13 19:20:00 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:20:00 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:20:00 user nova-compute[71692]:       <target dev="tap83ef4caf-d7"/>
Apr 13 19:20:00 user nova-compute[71692]:     </interface>
Apr 13 19:20:00 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:20:00 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/console.log" append="off"/>
Apr 13 19:20:00 user nova-compute[71692]:     </serial>
Apr 13 19:20:00 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:20:00 user nova-compute[71692]:     <video>
Apr 13 19:20:00 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:20:00 user nova-compute[71692]:     </video>
Apr 13 19:20:00 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:20:00 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:20:00 user nova-compute[71692]:     </rng>
Apr 13 19:20:00 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:20:00 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:20:00 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:20:00 user nova-compute[71692]:     </memballoon>
Apr 13 19:20:00 user nova-compute[71692]:   </devices>
Apr 13 19:20:00 user nova-compute[71692]: </domain>
Apr 13 19:20:00 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:19:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-609609545',display_name='tempest-VolumesSnapshotTestJSON-instance-609609545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-609609545',id=33,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='024f13d8c179482791ed1545b6b2efd8',ramdisk_id='',reservation_id='r-tcjup60b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-613917248',owner_user_name='tempest-VolumesSnapshotTestJSON-613917248-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:19:59Z,user_data=None,user_id='789fdd98ede74e6783b667178c2689fb',uuid=3b98531d-34ae-4f83-930a-3c970727fac8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "address": "fa:16:3e:3e:a3:90", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ef4caf-d7", "ovs_interfaceid": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Converting VIF {"id": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "address": "fa:16:3e:3e:a3:90", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ef4caf-d7", "ovs_interfaceid": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a3:90,bridge_name='br-int',has_traffic_filtering=True,id=83ef4caf-d717-4e45-9511-cfcc225f7b05,network=Network(0e855c73-cf7d-4c09-9fb5-3a4a7903b519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83ef4caf-d7') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG os_vif [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a3:90,bridge_name='br-int',has_traffic_filtering=True,id=83ef4caf-d717-4e45-9511-cfcc225f7b05,network=Network(0e855c73-cf7d-4c09-9fb5-3a4a7903b519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83ef4caf-d7') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83ef4caf-d7, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap83ef4caf-d7, col_values=(('external_ids', {'iface-id': '83ef4caf-d717-4e45-9511-cfcc225f7b05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:a3:90', 'vm-uuid': '3b98531d-34ae-4f83-930a-3c970727fac8'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:00 user nova-compute[71692]: INFO os_vif [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:a3:90,bridge_name='br-int',has_traffic_filtering=True,id=83ef4caf-d717-4e45-9511-cfcc225f7b05,network=Network(0e855c73-cf7d-4c09-9fb5-3a4a7903b519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83ef4caf-d7')
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:20:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] No VIF found with MAC fa:16:3e:3e:a3:90, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:20:01 user nova-compute[71692]: DEBUG nova.network.neutron [req-e840df87-8ec1-483c-9c1b-07dd4948c19a req-57a9e401-06ed-45dc-b904-4fef52c00d6c service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Updated VIF entry in instance network info cache for port 83ef4caf-d717-4e45-9511-cfcc225f7b05. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:20:01 user nova-compute[71692]: DEBUG nova.network.neutron [req-e840df87-8ec1-483c-9c1b-07dd4948c19a req-57a9e401-06ed-45dc-b904-4fef52c00d6c service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Updating instance_info_cache with network_info: [{"id": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "address": "fa:16:3e:3e:a3:90", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ef4caf-d7", "ovs_interfaceid": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:20:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e840df87-8ec1-483c-9c1b-07dd4948c19a req-57a9e401-06ed-45dc-b904-4fef52c00d6c service nova] Releasing lock "refresh_cache-3b98531d-34ae-4f83-930a-3c970727fac8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:20:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:02 user nova-compute[71692]: DEBUG nova.compute.manager [req-0ed6a539-8111-47a7-b393-d073e48814b1 req-088be258-ddd7-4f18-8ef8-737cf1a411a5 service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Received event network-vif-plugged-83ef4caf-d717-4e45-9511-cfcc225f7b05 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:20:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0ed6a539-8111-47a7-b393-d073e48814b1 req-088be258-ddd7-4f18-8ef8-737cf1a411a5 service nova] Acquiring lock "3b98531d-34ae-4f83-930a-3c970727fac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0ed6a539-8111-47a7-b393-d073e48814b1 req-088be258-ddd7-4f18-8ef8-737cf1a411a5 service nova] Lock "3b98531d-34ae-4f83-930a-3c970727fac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0ed6a539-8111-47a7-b393-d073e48814b1 req-088be258-ddd7-4f18-8ef8-737cf1a411a5 service nova] Lock "3b98531d-34ae-4f83-930a-3c970727fac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:02 user nova-compute[71692]: DEBUG nova.compute.manager [req-0ed6a539-8111-47a7-b393-d073e48814b1 req-088be258-ddd7-4f18-8ef8-737cf1a411a5 service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] No waiting events found dispatching network-vif-plugged-83ef4caf-d717-4e45-9511-cfcc225f7b05 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:20:02 user nova-compute[71692]: WARNING nova.compute.manager [req-0ed6a539-8111-47a7-b393-d073e48814b1 req-088be258-ddd7-4f18-8ef8-737cf1a411a5 service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Received unexpected event network-vif-plugged-83ef4caf-d717-4e45-9511-cfcc225f7b05 for instance with vm_state building and task_state spawning.
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413604.3417044, 3b98531d-34ae-4f83-930a-3c970727fac8 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:20:04 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] VM Resumed (Lifecycle Event)
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:20:04 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Instance spawned successfully.
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:20:04 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413604.3451843, 3b98531d-34ae-4f83-930a-3c970727fac8 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:20:04 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] VM Started (Lifecycle Event)
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-6b919b65-fa88-4e6f-8672-136ca945d5cf req-0183fc30-170c-4a44-a97e-70507c468999 service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Received event network-vif-plugged-83ef4caf-d717-4e45-9511-cfcc225f7b05 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:20:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6b919b65-fa88-4e6f-8672-136ca945d5cf req-0183fc30-170c-4a44-a97e-70507c468999 service nova] Acquiring lock "3b98531d-34ae-4f83-930a-3c970727fac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6b919b65-fa88-4e6f-8672-136ca945d5cf req-0183fc30-170c-4a44-a97e-70507c468999 service nova] Lock "3b98531d-34ae-4f83-930a-3c970727fac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-6b919b65-fa88-4e6f-8672-136ca945d5cf req-0183fc30-170c-4a44-a97e-70507c468999 service nova] Lock "3b98531d-34ae-4f83-930a-3c970727fac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-6b919b65-fa88-4e6f-8672-136ca945d5cf req-0183fc30-170c-4a44-a97e-70507c468999 service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] No waiting events found dispatching network-vif-plugged-83ef4caf-d717-4e45-9511-cfcc225f7b05 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:20:04 user nova-compute[71692]: WARNING nova.compute.manager [req-6b919b65-fa88-4e6f-8672-136ca945d5cf req-0183fc30-170c-4a44-a97e-70507c468999 service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Received unexpected event network-vif-plugged-83ef4caf-d717-4e45-9511-cfcc225f7b05 for instance with vm_state building and task_state spawning.
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:20:04 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:20:04 user nova-compute[71692]: INFO nova.compute.manager [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Took 5.30 seconds to spawn the instance on the hypervisor.
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:20:04 user nova-compute[71692]: INFO nova.compute.manager [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Took 5.82 seconds to build instance.
Apr 13 19:20:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a8ea229a-d383-427b-b66b-8fbe03099d32 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "3b98531d-34ae-4f83-930a-3c970727fac8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.902s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413589.8154657, 59d7b86a-c723-4255-827e-2f6a641239df => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:20:04 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] VM Stopped (Lifecycle Event)
Apr 13 19:20:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e21c2b27-1aad-45dd-8a3f-cdda6940c644 None None] [instance: 59d7b86a-c723-4255-827e-2f6a641239df] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:20:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:20:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "620bc9c9-26a0-461f-8771-418b3e9aea79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:19 user nova-compute[71692]: INFO nova.compute.manager [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Terminating instance
Apr 13 19:20:19 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:20:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:19 user nova-compute[71692]: DEBUG nova.compute.manager [req-4e52f28a-4136-40c9-b71f-8c2a5982a4e1 req-9af23ed2-9bb4-4ee9-b412-8112db1b8a63 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received event network-vif-unplugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:20:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4e52f28a-4136-40c9-b71f-8c2a5982a4e1 req-9af23ed2-9bb4-4ee9-b412-8112db1b8a63 service nova] Acquiring lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4e52f28a-4136-40c9-b71f-8c2a5982a4e1 req-9af23ed2-9bb4-4ee9-b412-8112db1b8a63 service nova] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4e52f28a-4136-40c9-b71f-8c2a5982a4e1 req-9af23ed2-9bb4-4ee9-b412-8112db1b8a63 service nova] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:19 user nova-compute[71692]: DEBUG nova.compute.manager [req-4e52f28a-4136-40c9-b71f-8c2a5982a4e1 req-9af23ed2-9bb4-4ee9-b412-8112db1b8a63 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] No waiting events found dispatching network-vif-unplugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:20:19 user nova-compute[71692]: DEBUG nova.compute.manager [req-4e52f28a-4136-40c9-b71f-8c2a5982a4e1 req-9af23ed2-9bb4-4ee9-b412-8112db1b8a63 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received event network-vif-unplugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:20 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Instance destroyed successfully.
Apr 13 19:20:20 user nova-compute[71692]: DEBUG nova.objects.instance [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'resources' on Instance uuid 620bc9c9-26a0-461f-8771-418b3e9aea79 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-451260104',display_name='tempest-AttachVolumeNegativeTest-server-451260104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-451260104',id=32,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqWTeW94mC6Qab592n4roQSgR0ReQD5GgNdKv6uLCTG70d8Ti2XZh02FAhLCrLlr4yJF7KPa+B4KdHaRg688OqQ3OKYgcRxDDHxlwTkNdr/Fm6F9nxu0scVEuiXFVXE8w==',key_name='tempest-keypair-737326002',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:17:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dcc458426af4ea2b4bbcfdf9b4fe041',ramdisk_id='',reservation_id='r-4vnemima',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-513091417',owner_user_name='tempest-AttachVolumeNegativeTest-513091417-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975d5fe9f1e445f0ba1be8fc71e93ecc',uuid=620bc9c9-26a0-461f-8771-418b3e9aea79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "address": "fa:16:3e:a6:27:19", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f25cc6-1d", "ovs_interfaceid": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converting VIF {"id": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "address": "fa:16:3e:a6:27:19", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f25cc6-1d", "ovs_interfaceid": "96f25cc6-1d0b-467a-be3e-a312cd09fbdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:27:19,bridge_name='br-int',has_traffic_filtering=True,id=96f25cc6-1d0b-467a-be3e-a312cd09fbdf,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f25cc6-1d') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG os_vif [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:27:19,bridge_name='br-int',has_traffic_filtering=True,id=96f25cc6-1d0b-467a-be3e-a312cd09fbdf,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f25cc6-1d') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96f25cc6-1d, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:20:20 user nova-compute[71692]: INFO os_vif [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:27:19,bridge_name='br-int',has_traffic_filtering=True,id=96f25cc6-1d0b-467a-be3e-a312cd09fbdf,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f25cc6-1d')
Apr 13 19:20:20 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Deleting instance files /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79_del
Apr 13 19:20:20 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Deletion of /opt/stack/data/nova/instances/620bc9c9-26a0-461f-8771-418b3e9aea79_del complete
Apr 13 19:20:20 user nova-compute[71692]: INFO nova.compute.manager [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 13 19:20:20 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:21 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:20:21 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Took 0.84 seconds to deallocate network for instance.
Apr 13 19:20:21 user nova-compute[71692]: DEBUG nova.compute.manager [req-d8878abe-007f-4a02-818d-0860bb3775d8 req-5a6601f1-c176-4af6-b8ad-6091a5149aa3 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received event network-vif-deleted-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:20:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:21 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:20:21 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:20:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:21 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Deleted allocations for instance 620bc9c9-26a0-461f-8771-418b3e9aea79
Apr 13 19:20:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-a695a03f-02b4-4d33-9ba7-e4b82064c8d6 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.086s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received event network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Acquiring lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] No waiting events found dispatching network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:20:22 user nova-compute[71692]: WARNING nova.compute.manager [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received unexpected event network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance with vm_state deleted and task_state None.
Apr 13 19:20:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received event network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Acquiring lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] No waiting events found dispatching network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:20:22 user nova-compute[71692]: WARNING nova.compute.manager [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received unexpected event network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance with vm_state deleted and task_state None.
Apr 13 19:20:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received event network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Acquiring lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] No waiting events found dispatching network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:20:22 user nova-compute[71692]: WARNING nova.compute.manager [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received unexpected event network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance with vm_state deleted and task_state None.
Apr 13 19:20:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received event network-vif-unplugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Acquiring lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] No waiting events found dispatching network-vif-unplugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:20:22 user nova-compute[71692]: WARNING nova.compute.manager [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received unexpected event network-vif-unplugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance with vm_state deleted and task_state None.
Apr 13 19:20:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received event network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Acquiring lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] Lock "620bc9c9-26a0-461f-8771-418b3e9aea79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] No waiting events found dispatching network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:20:22 user nova-compute[71692]: WARNING nova.compute.manager [req-3f88de2b-e0df-484b-a7db-d997125f4bf8 req-925d37cd-1c24-4fff-b435-deb117549aa0 service nova] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Received unexpected event network-vif-plugged-96f25cc6-1d0b-467a-be3e-a312cd09fbdf for instance with vm_state deleted and task_state None.
Apr 13 19:20:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "579c83e7-7976-47f4-9f25-a194e39966ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "579c83e7-7976-47f4-9f25-a194e39966ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "579c83e7-7976-47f4-9f25-a194e39966ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "579c83e7-7976-47f4-9f25-a194e39966ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "579c83e7-7976-47f4-9f25-a194e39966ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:29 user nova-compute[71692]: INFO nova.compute.manager [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Terminating instance
Apr 13 19:20:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Instance destroyed successfully.
Apr 13 19:20:29 user nova-compute[71692]: DEBUG nova.objects.instance [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lazy-loading 'resources' on Instance uuid 579c83e7-7976-47f4-9f25-a194e39966ba {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG nova.compute.manager [req-4fb4b474-8baa-4a44-9333-721ec0297b1b req-461db05b-7cce-451a-bc55-421580f45deb service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Received event network-vif-unplugged-ab959649-556a-479c-9e13-ec36fb9ebb66 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4fb4b474-8baa-4a44-9333-721ec0297b1b req-461db05b-7cce-451a-bc55-421580f45deb service nova] Acquiring lock "579c83e7-7976-47f4-9f25-a194e39966ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4fb4b474-8baa-4a44-9333-721ec0297b1b req-461db05b-7cce-451a-bc55-421580f45deb service nova] Lock "579c83e7-7976-47f4-9f25-a194e39966ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4fb4b474-8baa-4a44-9333-721ec0297b1b req-461db05b-7cce-451a-bc55-421580f45deb service nova] Lock "579c83e7-7976-47f4-9f25-a194e39966ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG nova.compute.manager [req-4fb4b474-8baa-4a44-9333-721ec0297b1b req-461db05b-7cce-451a-bc55-421580f45deb service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] No waiting events found dispatching network-vif-unplugged-ab959649-556a-479c-9e13-ec36fb9ebb66 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG nova.compute.manager [req-4fb4b474-8baa-4a44-9333-721ec0297b1b req-461db05b-7cce-451a-bc55-421580f45deb service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Received event network-vif-unplugged-ab959649-556a-479c-9e13-ec36fb9ebb66 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-624786944',display_name='tempest-ServerActionsTestJSON-server-624786944',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-624786944',id=25,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR+tC4S2wOckRURBl2CBsuQoZn9YTUk7dZ6/oOqQygta6JdBGn9bBq8O9jNwTC8nhl8hZFQewkPTbI0SJ4N+wM2P8bIju9KyXw+Q7oomRQ3Rz6SH5NUlBozIq0vQamOYw==',key_name='tempest-keypair-479347877',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:11:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c162f91cba4b4ecf9de48fbf839da261',ramdisk_id='',reservation_id='r-b0w0cukh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1901931474',owner_user_name='tempest-ServerActionsTestJSON-1901931474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:11:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df209814208d415e9d414d39205aaad6',uuid=579c83e7-7976-47f4-9f25-a194e39966ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab959649-556a-479c-9e13-ec36fb9ebb66", "address": "fa:16:3e:4b:6d:5f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab959649-55", "ovs_interfaceid": "ab959649-556a-479c-9e13-ec36fb9ebb66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converting VIF {"id": "ab959649-556a-479c-9e13-ec36fb9ebb66", "address": "fa:16:3e:4b:6d:5f", "network": {"id": "53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-383984590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c162f91cba4b4ecf9de48fbf839da261", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab959649-55", "ovs_interfaceid": "ab959649-556a-479c-9e13-ec36fb9ebb66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:6d:5f,bridge_name='br-int',has_traffic_filtering=True,id=ab959649-556a-479c-9e13-ec36fb9ebb66,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab959649-55') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG os_vif [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:6d:5f,bridge_name='br-int',has_traffic_filtering=True,id=ab959649-556a-479c-9e13-ec36fb9ebb66,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab959649-55') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab959649-55, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:29 user nova-compute[71692]: INFO os_vif [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:6d:5f,bridge_name='br-int',has_traffic_filtering=True,id=ab959649-556a-479c-9e13-ec36fb9ebb66,network=Network(53883aaa-ec3c-4cd2-b3ae-c0ffd788bb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab959649-55')
Apr 13 19:20:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Deleting instance files /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba_del
Apr 13 19:20:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Deletion of /opt/stack/data/nova/instances/579c83e7-7976-47f4-9f25-a194e39966ba_del complete
Apr 13 19:20:29 user nova-compute[71692]: INFO nova.compute.manager [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 13 19:20:29 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:20:29 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:20:30 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:20:30 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Took 0.46 seconds to deallocate network for instance.
Apr 13 19:20:30 user nova-compute[71692]: DEBUG nova.compute.manager [req-ac74be34-52ea-4132-8b78-fe88835b5fa4 req-5c740abc-15bd-4c72-a6e7-974e6b78601f service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Received event network-vif-deleted-ab959649-556a-479c-9e13-ec36fb9ebb66 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:20:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:30 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:20:30 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:20:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:30 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Deleted allocations for instance 579c83e7-7976-47f4-9f25-a194e39966ba
Apr 13 19:20:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-073c8aa7-df75-402e-b615-a4bc0cece502 tempest-ServerActionsTestJSON-1901931474 tempest-ServerActionsTestJSON-1901931474-project-member] Lock "579c83e7-7976-47f4-9f25-a194e39966ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.530s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-1758d8a5-9b37-4736-9c6c-470bcb2f85ca req-7cd9bcec-e1b3-4f1f-bdb2-386f9ca32610 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Received event network-vif-plugged-ab959649-556a-479c-9e13-ec36fb9ebb66 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:20:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1758d8a5-9b37-4736-9c6c-470bcb2f85ca req-7cd9bcec-e1b3-4f1f-bdb2-386f9ca32610 service nova] Acquiring lock "579c83e7-7976-47f4-9f25-a194e39966ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1758d8a5-9b37-4736-9c6c-470bcb2f85ca req-7cd9bcec-e1b3-4f1f-bdb2-386f9ca32610 service nova] Lock "579c83e7-7976-47f4-9f25-a194e39966ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1758d8a5-9b37-4736-9c6c-470bcb2f85ca req-7cd9bcec-e1b3-4f1f-bdb2-386f9ca32610 service nova] Lock "579c83e7-7976-47f4-9f25-a194e39966ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-1758d8a5-9b37-4736-9c6c-470bcb2f85ca req-7cd9bcec-e1b3-4f1f-bdb2-386f9ca32610 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] No waiting events found dispatching network-vif-plugged-ab959649-556a-479c-9e13-ec36fb9ebb66 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:20:31 user nova-compute[71692]: WARNING nova.compute.manager [req-1758d8a5-9b37-4736-9c6c-470bcb2f85ca req-7cd9bcec-e1b3-4f1f-bdb2-386f9ca32610 service nova] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Received unexpected event network-vif-plugged-ab959649-556a-479c-9e13-ec36fb9ebb66 for instance with vm_state deleted and task_state None.
Apr 13 19:20:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:35 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413620.4256783, 620bc9c9-26a0-461f-8771-418b3e9aea79 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:20:35 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] VM Stopped (Lifecycle Event)
Apr 13 19:20:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-4a1b8e3f-687a-4fdd-b2bb-0a0ab2dabd86 None None] [instance: 620bc9c9-26a0-461f-8771-418b3e9aea79] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:20:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:39 user nova-compute[71692]: INFO nova.compute.manager [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Terminating instance
Apr 13 19:20:39 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:20:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cddb34ed-9d96-46bc-ac11-e539f273d9e5 req-9cb7a491-4525-4f92-abc7-a144662545a4 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received event network-vif-unplugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cddb34ed-9d96-46bc-ac11-e539f273d9e5 req-9cb7a491-4525-4f92-abc7-a144662545a4 service nova] Acquiring lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cddb34ed-9d96-46bc-ac11-e539f273d9e5 req-9cb7a491-4525-4f92-abc7-a144662545a4 service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cddb34ed-9d96-46bc-ac11-e539f273d9e5 req-9cb7a491-4525-4f92-abc7-a144662545a4 service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cddb34ed-9d96-46bc-ac11-e539f273d9e5 req-9cb7a491-4525-4f92-abc7-a144662545a4 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] No waiting events found dispatching network-vif-unplugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cddb34ed-9d96-46bc-ac11-e539f273d9e5 req-9cb7a491-4525-4f92-abc7-a144662545a4 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received event network-vif-unplugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:20:40 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Instance destroyed successfully.
Apr 13 19:20:40 user nova-compute[71692]: DEBUG nova.objects.instance [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lazy-loading 'resources' on Instance uuid 29eeca99-f237-49d9-9c7d-5c5b7ff2892f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:03:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-644483843',display_name='tempest-ServerRescueNegativeTestJSON-server-644483843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-644483843',id=14,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:08:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42fbd7089a7e4ba8b2597fca0d8e84c8',ramdisk_id='',reservation_id='r-n2ktk0pw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1255770111',owner_user_name='tempest-ServerRescueNegativeTestJSON-1255770111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:10:30Z,user_data=None,user_id='3bebf61a7401492692f9c60adde178f7',uuid=29eeca99-f237-49d9-9c7d-5c5b7ff2892f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converting VIF {"id": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "address": "fa:16:3e:d1:ae:15", "network": {"id": "f17efc87-567e-4354-9c6b-86094fabd53c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1348349259-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42fbd7089a7e4ba8b2597fca0d8e84c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e8742b4-c8", "ovs_interfaceid": "0e8742b4-c86f-4294-9d67-8756f74a5b81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:ae:15,bridge_name='br-int',has_traffic_filtering=True,id=0e8742b4-c86f-4294-9d67-8756f74a5b81,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8742b4-c8') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG os_vif [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:ae:15,bridge_name='br-int',has_traffic_filtering=True,id=0e8742b4-c86f-4294-9d67-8756f74a5b81,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8742b4-c8') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e8742b4-c8, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:40 user nova-compute[71692]: INFO os_vif [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:ae:15,bridge_name='br-int',has_traffic_filtering=True,id=0e8742b4-c86f-4294-9d67-8756f74a5b81,network=Network(f17efc87-567e-4354-9c6b-86094fabd53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e8742b4-c8')
Apr 13 19:20:40 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Deleting instance files /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f_del
Apr 13 19:20:40 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Deletion of /opt/stack/data/nova/instances/29eeca99-f237-49d9-9c7d-5c5b7ff2892f_del complete
Apr 13 19:20:40 user nova-compute[71692]: INFO nova.compute.manager [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Took 0.64 seconds to destroy the instance on the hypervisor.
Apr 13 19:20:40 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:20:40 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Took 0.46 seconds to deallocate network for instance.
Apr 13 19:20:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:20:40 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:20:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:41 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Deleted allocations for instance 29eeca99-f237-49d9-9c7d-5c5b7ff2892f
Apr 13 19:20:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2b618f4a-45cb-487f-90a0-8353bdac04de tempest-ServerRescueNegativeTestJSON-1255770111 tempest-ServerRescueNegativeTestJSON-1255770111-project-member] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.470s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-8883f594-5334-4fa4-bb74-e2cd447c5894 req-169d5d7e-49e0-4357-aff0-805be0774907 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:20:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8883f594-5334-4fa4-bb74-e2cd447c5894 req-169d5d7e-49e0-4357-aff0-805be0774907 service nova] Acquiring lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8883f594-5334-4fa4-bb74-e2cd447c5894 req-169d5d7e-49e0-4357-aff0-805be0774907 service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8883f594-5334-4fa4-bb74-e2cd447c5894 req-169d5d7e-49e0-4357-aff0-805be0774907 service nova] Lock "29eeca99-f237-49d9-9c7d-5c5b7ff2892f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-8883f594-5334-4fa4-bb74-e2cd447c5894 req-169d5d7e-49e0-4357-aff0-805be0774907 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] No waiting events found dispatching network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:20:42 user nova-compute[71692]: WARNING nova.compute.manager [req-8883f594-5334-4fa4-bb74-e2cd447c5894 req-169d5d7e-49e0-4357-aff0-805be0774907 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received unexpected event network-vif-plugged-0e8742b4-c86f-4294-9d67-8756f74a5b81 for instance with vm_state deleted and task_state None.
Apr 13 19:20:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-8883f594-5334-4fa4-bb74-e2cd447c5894 req-169d5d7e-49e0-4357-aff0-805be0774907 service nova] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Received event network-vif-deleted-0e8742b4-c86f-4294-9d67-8756f74a5b81 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:20:43 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:20:44 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413629.6998599, 579c83e7-7976-47f4-9f25-a194e39966ba => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:20:44 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] VM Stopped (Lifecycle Event)
Apr 13 19:20:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-52648586-bdcb-49f0-9282-237b8058ee61 None None] [instance: 579c83e7-7976-47f4-9f25-a194e39966ba] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:20:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:47 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:20:48 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:20:48 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:20:48 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:20:49 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:20:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:20:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Didn't find any instances for network info cache update. {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 19:20:50 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:20:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:20:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:20:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:20:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:20:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:20:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:20:50 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:20:50 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:20:50 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8667MB free_disk=26.17757797241211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:20:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:20:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:20:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 3b98531d-34ae-4f83-930a-3c970727fac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:20:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:20:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:20:51 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:20:51 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:20:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:20:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:20:52 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:20:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:20:52 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:20:54 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:20:55 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413640.2861211, 29eeca99-f237-49d9-9c7d-5c5b7ff2892f => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:20:55 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] VM Stopped (Lifecycle Event)
Apr 13 19:20:55 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0f292792-ae4f-4afc-b06e-87647b5b82c3 None None] [instance: 29eeca99-f237-49d9-9c7d-5c5b7ff2892f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:20:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:21:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "ca38627f-4cf1-4331-b447-7e32134e3286" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ca38627f-4cf1-4331-b447-7e32134e3286" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:21:13 user nova-compute[71692]: INFO nova.compute.claims [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Claim successful on node user
Apr 13 19:21:13 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG nova.network.neutron [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:21:13 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:21:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG nova.policy [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '975d5fe9f1e445f0ba1be8fc71e93ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcc458426af4ea2b4bbcfdf9b4fe041', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:21:13 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Creating image(s)
Apr 13 19:21:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "/opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "/opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.128s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk 1073741824" returned: 0 in 0.048s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.128s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:14 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:21:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:14 user nova-compute[71692]: DEBUG nova.network.neutron [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Successfully created port: f9b73165-75e2-47ed-a836-d0704aa5788d {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:21:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:14 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Cannot resize image /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:21:14 user nova-compute[71692]: DEBUG nova.objects.instance [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'migration_context' on Instance uuid ca38627f-4cf1-4331-b447-7e32134e3286 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:21:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:21:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Ensure instance console log exists: /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:21:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.network.neutron [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Successfully updated port: f9b73165-75e2-47ed-a836-d0704aa5788d {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "refresh_cache-ca38627f-4cf1-4331-b447-7e32134e3286" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquired lock "refresh_cache-ca38627f-4cf1-4331-b447-7e32134e3286" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.network.neutron [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-b72e78e0-2f19-4d26-bc5c-64b62c967f32 req-955f374a-a56c-4f86-87e2-f306e9b0a7b0 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Received event network-changed-f9b73165-75e2-47ed-a836-d0704aa5788d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-b72e78e0-2f19-4d26-bc5c-64b62c967f32 req-955f374a-a56c-4f86-87e2-f306e9b0a7b0 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Refreshing instance network info cache due to event network-changed-f9b73165-75e2-47ed-a836-d0704aa5788d. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b72e78e0-2f19-4d26-bc5c-64b62c967f32 req-955f374a-a56c-4f86-87e2-f306e9b0a7b0 service nova] Acquiring lock "refresh_cache-ca38627f-4cf1-4331-b447-7e32134e3286" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.network.neutron [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.network.neutron [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Updating instance_info_cache with network_info: [{"id": "f9b73165-75e2-47ed-a836-d0704aa5788d", "address": "fa:16:3e:0b:98:c2", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b73165-75", "ovs_interfaceid": "f9b73165-75e2-47ed-a836-d0704aa5788d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Releasing lock "refresh_cache-ca38627f-4cf1-4331-b447-7e32134e3286" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Instance network_info: |[{"id": "f9b73165-75e2-47ed-a836-d0704aa5788d", "address": "fa:16:3e:0b:98:c2", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b73165-75", "ovs_interfaceid": "f9b73165-75e2-47ed-a836-d0704aa5788d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b72e78e0-2f19-4d26-bc5c-64b62c967f32 req-955f374a-a56c-4f86-87e2-f306e9b0a7b0 service nova] Acquired lock "refresh_cache-ca38627f-4cf1-4331-b447-7e32134e3286" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.network.neutron [req-b72e78e0-2f19-4d26-bc5c-64b62c967f32 req-955f374a-a56c-4f86-87e2-f306e9b0a7b0 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Refreshing network info cache for port f9b73165-75e2-47ed-a836-d0704aa5788d {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Start _get_guest_xml network_info=[{"id": "f9b73165-75e2-47ed-a836-d0704aa5788d", "address": "fa:16:3e:0b:98:c2", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b73165-75", "ovs_interfaceid": "f9b73165-75e2-47ed-a836-d0704aa5788d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:21:15 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:21:15 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-592910104',display_name='tempest-AttachVolumeNegativeTest-server-592910104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-592910104',id=34,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyAbm8EUX7I3WFkjXDhcrtssdTYxRcV2GP2/3HprEw0XnjvcQ1CZy+BxvGIuVIAWsa+Rr1WjExbjtk5cqwB2WF85y7qrU1xPaGFgdUsE25Bird1Sw4XYS1a3UKKtgXDRQ==',key_name='tempest-keypair-1088218711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dcc458426af4ea2b4bbcfdf9b4fe041',ramdisk_id='',reservation_id='r-swdz0sq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-513091417',owner_user_name='tempest-AttachVolumeNegativeTest-513091417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975d5fe9f1e445f0ba1be8fc71e93ecc',uuid=ca38627f-4cf1-4331-b447-7e32134e3286,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9b73165-75e2-47ed-a836-d0704aa5788d", "address": "fa:16:3e:0b:98:c2", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b73165-75", "ovs_interfaceid": "f9b73165-75e2-47ed-a836-d0704aa5788d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converting VIF {"id": "f9b73165-75e2-47ed-a836-d0704aa5788d", "address": "fa:16:3e:0b:98:c2", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b73165-75", "ovs_interfaceid": "f9b73165-75e2-47ed-a836-d0704aa5788d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:98:c2,bridge_name='br-int',has_traffic_filtering=True,id=f9b73165-75e2-47ed-a836-d0704aa5788d,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b73165-75') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.objects.instance [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'pci_devices' on Instance uuid ca38627f-4cf1-4331-b447-7e32134e3286 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:21:15 user nova-compute[71692]:   <uuid>ca38627f-4cf1-4331-b447-7e32134e3286</uuid>
Apr 13 19:21:15 user nova-compute[71692]:   <name>instance-00000022</name>
Apr 13 19:21:15 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:21:15 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:21:15 user nova-compute[71692]:   <metadata>
Apr 13 19:21:15 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:21:15 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:21:15 user nova-compute[71692]:       <nova:name>tempest-AttachVolumeNegativeTest-server-592910104</nova:name>
Apr 13 19:21:15 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:21:15</nova:creationTime>
Apr 13 19:21:15 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:21:15 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:21:15 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:21:15 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:21:15 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:21:15 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:21:15 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:21:15 user nova-compute[71692]:       <nova:owner>
Apr 13 19:21:15 user nova-compute[71692]:         <nova:user uuid="975d5fe9f1e445f0ba1be8fc71e93ecc">tempest-AttachVolumeNegativeTest-513091417-project-member</nova:user>
Apr 13 19:21:15 user nova-compute[71692]:         <nova:project uuid="0dcc458426af4ea2b4bbcfdf9b4fe041">tempest-AttachVolumeNegativeTest-513091417</nova:project>
Apr 13 19:21:15 user nova-compute[71692]:       </nova:owner>
Apr 13 19:21:15 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:21:15 user nova-compute[71692]:       <nova:ports>
Apr 13 19:21:15 user nova-compute[71692]:         <nova:port uuid="f9b73165-75e2-47ed-a836-d0704aa5788d">
Apr 13 19:21:15 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 19:21:15 user nova-compute[71692]:         </nova:port>
Apr 13 19:21:15 user nova-compute[71692]:       </nova:ports>
Apr 13 19:21:15 user nova-compute[71692]:     </nova:instance>
Apr 13 19:21:15 user nova-compute[71692]:   </metadata>
Apr 13 19:21:15 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:21:15 user nova-compute[71692]:     <system>
Apr 13 19:21:15 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:21:15 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:21:15 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:21:15 user nova-compute[71692]:       <entry name="serial">ca38627f-4cf1-4331-b447-7e32134e3286</entry>
Apr 13 19:21:15 user nova-compute[71692]:       <entry name="uuid">ca38627f-4cf1-4331-b447-7e32134e3286</entry>
Apr 13 19:21:15 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:21:15 user nova-compute[71692]:     </system>
Apr 13 19:21:15 user nova-compute[71692]:   </sysinfo>
Apr 13 19:21:15 user nova-compute[71692]:   <os>
Apr 13 19:21:15 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:21:15 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:21:15 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:21:15 user nova-compute[71692]:   </os>
Apr 13 19:21:15 user nova-compute[71692]:   <features>
Apr 13 19:21:15 user nova-compute[71692]:     <acpi/>
Apr 13 19:21:15 user nova-compute[71692]:     <apic/>
Apr 13 19:21:15 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:21:15 user nova-compute[71692]:   </features>
Apr 13 19:21:15 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:21:15 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:21:15 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:21:15 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:21:15 user nova-compute[71692]:   </clock>
Apr 13 19:21:15 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:21:15 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:21:15 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:21:15 user nova-compute[71692]:   </cpu>
Apr 13 19:21:15 user nova-compute[71692]:   <devices>
Apr 13 19:21:15 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:21:15 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:21:15 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk"/>
Apr 13 19:21:15 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:21:15 user nova-compute[71692]:     </disk>
Apr 13 19:21:15 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:21:15 user nova-compute[71692]:       <mac address="fa:16:3e:0b:98:c2"/>
Apr 13 19:21:15 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:21:15 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:21:15 user nova-compute[71692]:       <target dev="tapf9b73165-75"/>
Apr 13 19:21:15 user nova-compute[71692]:     </interface>
Apr 13 19:21:15 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:21:15 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/console.log" append="off"/>
Apr 13 19:21:15 user nova-compute[71692]:     </serial>
Apr 13 19:21:15 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:21:15 user nova-compute[71692]:     <video>
Apr 13 19:21:15 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:21:15 user nova-compute[71692]:     </video>
Apr 13 19:21:15 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:21:15 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:21:15 user nova-compute[71692]:     </rng>
Apr 13 19:21:15 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:21:15 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:21:15 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:21:15 user nova-compute[71692]:     </memballoon>
Apr 13 19:21:15 user nova-compute[71692]:   </devices>
Apr 13 19:21:15 user nova-compute[71692]: </domain>
Apr 13 19:21:15 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-592910104',display_name='tempest-AttachVolumeNegativeTest-server-592910104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-592910104',id=34,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyAbm8EUX7I3WFkjXDhcrtssdTYxRcV2GP2/3HprEw0XnjvcQ1CZy+BxvGIuVIAWsa+Rr1WjExbjtk5cqwB2WF85y7qrU1xPaGFgdUsE25Bird1Sw4XYS1a3UKKtgXDRQ==',key_name='tempest-keypair-1088218711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0dcc458426af4ea2b4bbcfdf9b4fe041',ramdisk_id='',reservation_id='r-swdz0sq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-513091417',owner_user_name='tempest-AttachVolumeNegativeTest-513091417-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975d5fe9f1e445f0ba1be8fc71e93ecc',uuid=ca38627f-4cf1-4331-b447-7e32134e3286,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9b73165-75e2-47ed-a836-d0704aa5788d", "address": "fa:16:3e:0b:98:c2", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b73165-75", "ovs_interfaceid": "f9b73165-75e2-47ed-a836-d0704aa5788d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converting VIF {"id": "f9b73165-75e2-47ed-a836-d0704aa5788d", "address": "fa:16:3e:0b:98:c2", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b73165-75", "ovs_interfaceid": "f9b73165-75e2-47ed-a836-d0704aa5788d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:98:c2,bridge_name='br-int',has_traffic_filtering=True,id=f9b73165-75e2-47ed-a836-d0704aa5788d,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b73165-75') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG os_vif [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:98:c2,bridge_name='br-int',has_traffic_filtering=True,id=f9b73165-75e2-47ed-a836-d0704aa5788d,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b73165-75') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9b73165-75, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9b73165-75, col_values=(('external_ids', {'iface-id': 'f9b73165-75e2-47ed-a836-d0704aa5788d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:98:c2', 'vm-uuid': 'ca38627f-4cf1-4331-b447-7e32134e3286'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:15 user nova-compute[71692]: INFO os_vif [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:98:c2,bridge_name='br-int',has_traffic_filtering=True,id=f9b73165-75e2-47ed-a836-d0704aa5788d,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b73165-75')
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:21:15 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] No VIF found with MAC fa:16:3e:0b:98:c2, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:21:16 user nova-compute[71692]: DEBUG nova.network.neutron [req-b72e78e0-2f19-4d26-bc5c-64b62c967f32 req-955f374a-a56c-4f86-87e2-f306e9b0a7b0 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Updated VIF entry in instance network info cache for port f9b73165-75e2-47ed-a836-d0704aa5788d. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:21:16 user nova-compute[71692]: DEBUG nova.network.neutron [req-b72e78e0-2f19-4d26-bc5c-64b62c967f32 req-955f374a-a56c-4f86-87e2-f306e9b0a7b0 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Updating instance_info_cache with network_info: [{"id": "f9b73165-75e2-47ed-a836-d0704aa5788d", "address": "fa:16:3e:0b:98:c2", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b73165-75", "ovs_interfaceid": "f9b73165-75e2-47ed-a836-d0704aa5788d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:21:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b72e78e0-2f19-4d26-bc5c-64b62c967f32 req-955f374a-a56c-4f86-87e2-f306e9b0a7b0 service nova] Releasing lock "refresh_cache-ca38627f-4cf1-4331-b447-7e32134e3286" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:21:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-93d1186e-741c-4ca3-b6ee-62ddac621bcd req-52dbb27c-7d75-494f-aa89-9e1002c256e1 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Received event network-vif-plugged-f9b73165-75e2-47ed-a836-d0704aa5788d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:21:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-93d1186e-741c-4ca3-b6ee-62ddac621bcd req-52dbb27c-7d75-494f-aa89-9e1002c256e1 service nova] Acquiring lock "ca38627f-4cf1-4331-b447-7e32134e3286-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-93d1186e-741c-4ca3-b6ee-62ddac621bcd req-52dbb27c-7d75-494f-aa89-9e1002c256e1 service nova] Lock "ca38627f-4cf1-4331-b447-7e32134e3286-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-93d1186e-741c-4ca3-b6ee-62ddac621bcd req-52dbb27c-7d75-494f-aa89-9e1002c256e1 service nova] Lock "ca38627f-4cf1-4331-b447-7e32134e3286-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:17 user nova-compute[71692]: DEBUG nova.compute.manager [req-93d1186e-741c-4ca3-b6ee-62ddac621bcd req-52dbb27c-7d75-494f-aa89-9e1002c256e1 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] No waiting events found dispatching network-vif-plugged-f9b73165-75e2-47ed-a836-d0704aa5788d {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:21:17 user nova-compute[71692]: WARNING nova.compute.manager [req-93d1186e-741c-4ca3-b6ee-62ddac621bcd req-52dbb27c-7d75-494f-aa89-9e1002c256e1 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Received unexpected event network-vif-plugged-f9b73165-75e2-47ed-a836-d0704aa5788d for instance with vm_state building and task_state spawning.
Apr 13 19:21:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413679.197153, ca38627f-4cf1-4331-b447-7e32134e3286 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:21:19 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] VM Resumed (Lifecycle Event)
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.compute.manager [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:21:19 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Instance spawned successfully.
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:21:19 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413679.2005715, ca38627f-4cf1-4331-b447-7e32134e3286 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:21:19 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] VM Started (Lifecycle Event)
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:21:19 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:21:19 user nova-compute[71692]: INFO nova.compute.manager [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Took 5.61 seconds to spawn the instance on the hypervisor.
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.compute.manager [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:21:19 user nova-compute[71692]: INFO nova.compute.manager [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Took 6.11 seconds to build instance.
Apr 13 19:21:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-cb4e8eff-a5b4-4876-b603-4d9b76b8100a tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ca38627f-4cf1-4331-b447-7e32134e3286" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.239s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.compute.manager [req-3bac2b2b-4bfb-4b3f-8925-55ea16955792 req-9f79f7ee-bfe3-4153-8b1f-49bec95b56ac service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Received event network-vif-plugged-f9b73165-75e2-47ed-a836-d0704aa5788d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:21:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3bac2b2b-4bfb-4b3f-8925-55ea16955792 req-9f79f7ee-bfe3-4153-8b1f-49bec95b56ac service nova] Acquiring lock "ca38627f-4cf1-4331-b447-7e32134e3286-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3bac2b2b-4bfb-4b3f-8925-55ea16955792 req-9f79f7ee-bfe3-4153-8b1f-49bec95b56ac service nova] Lock "ca38627f-4cf1-4331-b447-7e32134e3286-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3bac2b2b-4bfb-4b3f-8925-55ea16955792 req-9f79f7ee-bfe3-4153-8b1f-49bec95b56ac service nova] Lock "ca38627f-4cf1-4331-b447-7e32134e3286-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:19 user nova-compute[71692]: DEBUG nova.compute.manager [req-3bac2b2b-4bfb-4b3f-8925-55ea16955792 req-9f79f7ee-bfe3-4153-8b1f-49bec95b56ac service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] No waiting events found dispatching network-vif-plugged-f9b73165-75e2-47ed-a836-d0704aa5788d {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:21:19 user nova-compute[71692]: WARNING nova.compute.manager [req-3bac2b2b-4bfb-4b3f-8925-55ea16955792 req-9f79f7ee-bfe3-4153-8b1f-49bec95b56ac service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Received unexpected event network-vif-plugged-f9b73165-75e2-47ed-a836-d0704aa5788d for instance with vm_state active and task_state None.
Apr 13 19:21:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:30 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:21:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:38 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:21:38 user nova-compute[71692]: INFO nova.compute.claims [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Claim successful on node user
Apr 13 19:21:38 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:21:38 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:21:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:21:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:21:38 user nova-compute[71692]: DEBUG nova.network.neutron [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:21:38 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:21:39 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG nova.policy [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:21:39 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Creating image(s)
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "/opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "/opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.207s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.149s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk 1073741824" returned: 0 in 0.052s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG nova.network.neutron [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Successfully created port: 5bd81344-f669-49c6-897f-97510d86e77b {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.148s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Cannot resize image /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG nova.objects.instance [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'migration_context' on Instance uuid 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Ensure instance console log exists: /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Successfully updated port: 5bd81344-f669-49c6-897f-97510d86e77b {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:21:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:21:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquired lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:21:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:21:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-51415a6c-a2e5-4913-ac69-1dda0472c829 req-6534f52a-2457-4b63-a3f2-6c07739eb98e service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Received event network-changed-5bd81344-f669-49c6-897f-97510d86e77b {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:21:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-51415a6c-a2e5-4913-ac69-1dda0472c829 req-6534f52a-2457-4b63-a3f2-6c07739eb98e service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Refreshing instance network info cache due to event network-changed-5bd81344-f669-49c6-897f-97510d86e77b. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:21:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-51415a6c-a2e5-4913-ac69-1dda0472c829 req-6534f52a-2457-4b63-a3f2-6c07739eb98e service nova] Acquiring lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:21:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:21:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.network.neutron [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updating instance_info_cache with network_info: [{"id": "5bd81344-f669-49c6-897f-97510d86e77b", "address": "fa:16:3e:01:0c:f9", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd81344-f6", "ovs_interfaceid": "5bd81344-f669-49c6-897f-97510d86e77b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Releasing lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Instance network_info: |[{"id": "5bd81344-f669-49c6-897f-97510d86e77b", "address": "fa:16:3e:01:0c:f9", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd81344-f6", "ovs_interfaceid": "5bd81344-f669-49c6-897f-97510d86e77b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-51415a6c-a2e5-4913-ac69-1dda0472c829 req-6534f52a-2457-4b63-a3f2-6c07739eb98e service nova] Acquired lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.network.neutron [req-51415a6c-a2e5-4913-ac69-1dda0472c829 req-6534f52a-2457-4b63-a3f2-6c07739eb98e service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Refreshing network info cache for port 5bd81344-f669-49c6-897f-97510d86e77b {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Start _get_guest_xml network_info=[{"id": "5bd81344-f669-49c6-897f-97510d86e77b", "address": "fa:16:3e:01:0c:f9", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd81344-f6", "ovs_interfaceid": "5bd81344-f669-49c6-897f-97510d86e77b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:21:41 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:21:41 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1490322609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1490322609',id=35,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c00a7fcd6d3040e8b2db0448eeda93ad',ramdisk_id='',reservation_id='r-ke3m9ivx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:21:39Z,user_data=None,user_id='dd604fa4d17b42b1abea8c2f2405b58d',uuid=2d0186ca-d0ab-46f3-b9b5-6461e8ceef96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bd81344-f669-49c6-897f-97510d86e77b", "address": "fa:16:3e:01:0c:f9", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd81344-f6", "ovs_interfaceid": "5bd81344-f669-49c6-897f-97510d86e77b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converting VIF {"id": "5bd81344-f669-49c6-897f-97510d86e77b", "address": "fa:16:3e:01:0c:f9", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd81344-f6", "ovs_interfaceid": "5bd81344-f669-49c6-897f-97510d86e77b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:0c:f9,bridge_name='br-int',has_traffic_filtering=True,id=5bd81344-f669-49c6-897f-97510d86e77b,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd81344-f6') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.objects.instance [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:21:41 user nova-compute[71692]:   <uuid>2d0186ca-d0ab-46f3-b9b5-6461e8ceef96</uuid>
Apr 13 19:21:41 user nova-compute[71692]:   <name>instance-00000023</name>
Apr 13 19:21:41 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:21:41 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:21:41 user nova-compute[71692]:   <metadata>
Apr 13 19:21:41 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:21:41 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:21:41 user nova-compute[71692]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1490322609</nova:name>
Apr 13 19:21:41 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:21:41</nova:creationTime>
Apr 13 19:21:41 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:21:41 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:21:41 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:21:41 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:21:41 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:21:41 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:21:41 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:21:41 user nova-compute[71692]:       <nova:owner>
Apr 13 19:21:41 user nova-compute[71692]:         <nova:user uuid="dd604fa4d17b42b1abea8c2f2405b58d">tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member</nova:user>
Apr 13 19:21:41 user nova-compute[71692]:         <nova:project uuid="c00a7fcd6d3040e8b2db0448eeda93ad">tempest-ServerBootFromVolumeStableRescueTest-1051313256</nova:project>
Apr 13 19:21:41 user nova-compute[71692]:       </nova:owner>
Apr 13 19:21:41 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:21:41 user nova-compute[71692]:       <nova:ports>
Apr 13 19:21:41 user nova-compute[71692]:         <nova:port uuid="5bd81344-f669-49c6-897f-97510d86e77b">
Apr 13 19:21:41 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 19:21:41 user nova-compute[71692]:         </nova:port>
Apr 13 19:21:41 user nova-compute[71692]:       </nova:ports>
Apr 13 19:21:41 user nova-compute[71692]:     </nova:instance>
Apr 13 19:21:41 user nova-compute[71692]:   </metadata>
Apr 13 19:21:41 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:21:41 user nova-compute[71692]:     <system>
Apr 13 19:21:41 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:21:41 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:21:41 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:21:41 user nova-compute[71692]:       <entry name="serial">2d0186ca-d0ab-46f3-b9b5-6461e8ceef96</entry>
Apr 13 19:21:41 user nova-compute[71692]:       <entry name="uuid">2d0186ca-d0ab-46f3-b9b5-6461e8ceef96</entry>
Apr 13 19:21:41 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:21:41 user nova-compute[71692]:     </system>
Apr 13 19:21:41 user nova-compute[71692]:   </sysinfo>
Apr 13 19:21:41 user nova-compute[71692]:   <os>
Apr 13 19:21:41 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:21:41 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:21:41 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:21:41 user nova-compute[71692]:   </os>
Apr 13 19:21:41 user nova-compute[71692]:   <features>
Apr 13 19:21:41 user nova-compute[71692]:     <acpi/>
Apr 13 19:21:41 user nova-compute[71692]:     <apic/>
Apr 13 19:21:41 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:21:41 user nova-compute[71692]:   </features>
Apr 13 19:21:41 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:21:41 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:21:41 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:21:41 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:21:41 user nova-compute[71692]:   </clock>
Apr 13 19:21:41 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:21:41 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:21:41 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:21:41 user nova-compute[71692]:   </cpu>
Apr 13 19:21:41 user nova-compute[71692]:   <devices>
Apr 13 19:21:41 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:21:41 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:21:41 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk"/>
Apr 13 19:21:41 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:21:41 user nova-compute[71692]:     </disk>
Apr 13 19:21:41 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:21:41 user nova-compute[71692]:       <mac address="fa:16:3e:01:0c:f9"/>
Apr 13 19:21:41 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:21:41 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:21:41 user nova-compute[71692]:       <target dev="tap5bd81344-f6"/>
Apr 13 19:21:41 user nova-compute[71692]:     </interface>
Apr 13 19:21:41 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:21:41 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/console.log" append="off"/>
Apr 13 19:21:41 user nova-compute[71692]:     </serial>
Apr 13 19:21:41 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:21:41 user nova-compute[71692]:     <video>
Apr 13 19:21:41 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:21:41 user nova-compute[71692]:     </video>
Apr 13 19:21:41 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:21:41 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:21:41 user nova-compute[71692]:     </rng>
Apr 13 19:21:41 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:21:41 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:21:41 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:21:41 user nova-compute[71692]:     </memballoon>
Apr 13 19:21:41 user nova-compute[71692]:   </devices>
Apr 13 19:21:41 user nova-compute[71692]: </domain>
Apr 13 19:21:41 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1490322609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1490322609',id=35,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c00a7fcd6d3040e8b2db0448eeda93ad',ramdisk_id='',reservation_id='r-ke3m9ivx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:21:39Z,user_data=None,user_id='dd604fa4d17b42b1abea8c2f2405b58d',uuid=2d0186ca-d0ab-46f3-b9b5-6461e8ceef96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bd81344-f669-49c6-897f-97510d86e77b", "address": "fa:16:3e:01:0c:f9", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd81344-f6", "ovs_interfaceid": "5bd81344-f669-49c6-897f-97510d86e77b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converting VIF {"id": "5bd81344-f669-49c6-897f-97510d86e77b", "address": "fa:16:3e:01:0c:f9", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd81344-f6", "ovs_interfaceid": "5bd81344-f669-49c6-897f-97510d86e77b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:0c:f9,bridge_name='br-int',has_traffic_filtering=True,id=5bd81344-f669-49c6-897f-97510d86e77b,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd81344-f6') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG os_vif [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:0c:f9,bridge_name='br-int',has_traffic_filtering=True,id=5bd81344-f669-49c6-897f-97510d86e77b,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd81344-f6') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bd81344-f6, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5bd81344-f6, col_values=(('external_ids', {'iface-id': '5bd81344-f669-49c6-897f-97510d86e77b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:0c:f9', 'vm-uuid': '2d0186ca-d0ab-46f3-b9b5-6461e8ceef96'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:41 user nova-compute[71692]: INFO os_vif [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:0c:f9,bridge_name='br-int',has_traffic_filtering=True,id=5bd81344-f669-49c6-897f-97510d86e77b,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd81344-f6')
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] No VIF found with MAC fa:16:3e:01:0c:f9, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.network.neutron [req-51415a6c-a2e5-4913-ac69-1dda0472c829 req-6534f52a-2457-4b63-a3f2-6c07739eb98e service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updated VIF entry in instance network info cache for port 5bd81344-f669-49c6-897f-97510d86e77b. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG nova.network.neutron [req-51415a6c-a2e5-4913-ac69-1dda0472c829 req-6534f52a-2457-4b63-a3f2-6c07739eb98e service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updating instance_info_cache with network_info: [{"id": "5bd81344-f669-49c6-897f-97510d86e77b", "address": "fa:16:3e:01:0c:f9", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd81344-f6", "ovs_interfaceid": "5bd81344-f669-49c6-897f-97510d86e77b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-51415a6c-a2e5-4913-ac69-1dda0472c829 req-6534f52a-2457-4b63-a3f2-6c07739eb98e service nova] Releasing lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:21:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-93222fea-396f-4b91-a382-42f0a20a0d9e req-2f7fc714-815a-4c6e-9afc-03adb16b48ff service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Received event network-vif-plugged-5bd81344-f669-49c6-897f-97510d86e77b {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:21:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-93222fea-396f-4b91-a382-42f0a20a0d9e req-2f7fc714-815a-4c6e-9afc-03adb16b48ff service nova] Acquiring lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-93222fea-396f-4b91-a382-42f0a20a0d9e req-2f7fc714-815a-4c6e-9afc-03adb16b48ff service nova] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-93222fea-396f-4b91-a382-42f0a20a0d9e req-2f7fc714-815a-4c6e-9afc-03adb16b48ff service nova] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-93222fea-396f-4b91-a382-42f0a20a0d9e req-2f7fc714-815a-4c6e-9afc-03adb16b48ff service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] No waiting events found dispatching network-vif-plugged-5bd81344-f669-49c6-897f-97510d86e77b {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:21:42 user nova-compute[71692]: WARNING nova.compute.manager [req-93222fea-396f-4b91-a382-42f0a20a0d9e req-2f7fc714-815a-4c6e-9afc-03adb16b48ff service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Received unexpected event network-vif-plugged-5bd81344-f669-49c6-897f-97510d86e77b for instance with vm_state building and task_state spawning.
Apr 13 19:21:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413704.7075245, 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:21:44 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] VM Resumed (Lifecycle Event)
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:21:44 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Instance spawned successfully.
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:21:44 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413704.7108986, 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:21:44 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] VM Started (Lifecycle Event)
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:21:44 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:21:44 user nova-compute[71692]: INFO nova.compute.manager [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Took 5.74 seconds to spawn the instance on the hypervisor.
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-2ef1a969-f282-4d5f-872e-45edbbdae28d req-4f9a739a-4e3b-4ddf-ab99-9d2e466c461d service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Received event network-vif-plugged-5bd81344-f669-49c6-897f-97510d86e77b {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:21:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2ef1a969-f282-4d5f-872e-45edbbdae28d req-4f9a739a-4e3b-4ddf-ab99-9d2e466c461d service nova] Acquiring lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2ef1a969-f282-4d5f-872e-45edbbdae28d req-4f9a739a-4e3b-4ddf-ab99-9d2e466c461d service nova] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2ef1a969-f282-4d5f-872e-45edbbdae28d req-4f9a739a-4e3b-4ddf-ab99-9d2e466c461d service nova] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-2ef1a969-f282-4d5f-872e-45edbbdae28d req-4f9a739a-4e3b-4ddf-ab99-9d2e466c461d service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] No waiting events found dispatching network-vif-plugged-5bd81344-f669-49c6-897f-97510d86e77b {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:21:44 user nova-compute[71692]: WARNING nova.compute.manager [req-2ef1a969-f282-4d5f-872e-45edbbdae28d req-4f9a739a-4e3b-4ddf-ab99-9d2e466c461d service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Received unexpected event network-vif-plugged-5bd81344-f669-49c6-897f-97510d86e77b for instance with vm_state building and task_state spawning.
Apr 13 19:21:44 user nova-compute[71692]: INFO nova.compute.manager [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Took 6.31 seconds to build instance.
Apr 13 19:21:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b1f0b9dc-518c-474e-b59f-96cf33c80ce8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.413s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:45 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:21:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:48 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:21:48 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "3b98531d-34ae-4f83-930a-3c970727fac8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "3b98531d-34ae-4f83-930a-3c970727fac8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG nova.objects.instance [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lazy-loading 'flavor' on Instance uuid 3b98531d-34ae-4f83-930a-3c970727fac8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:21:49 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Ignoring supplied device name: /dev/vdb
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "3b98531d-34ae-4f83-930a-3c970727fac8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-3b98531d-34ae-4f83-930a-3c970727fac8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-3b98531d-34ae-4f83-930a-3c970727fac8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG nova.objects.instance [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lazy-loading 'info_cache' on Instance uuid 3b98531d-34ae-4f83-930a-3c970727fac8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "3b98531d-34ae-4f83-930a-3c970727fac8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "3b98531d-34ae-4f83-930a-3c970727fac8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:49 user nova-compute[71692]: INFO nova.compute.manager [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Attaching volume 303df430-ed5e-409c-8be1-44341b1dbc4e to /dev/vdb
Apr 13 19:21:49 user nova-compute[71692]: DEBUG os_brick.utils [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1743c3d-77eb-4c01-b278-3470500ec7a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b7d6f1-12fd-4d7d-a74a-820addbaac2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7238beff-df9a-4b76-a786-fac64473e49b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[be167c66-7f1e-454c-a8ce-7d3aa92dc033]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:21:49 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ee62ed-863c-47fe-8e89-b417ed8ce626]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG os_brick.utils [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Updating existing volume attachment record: 9a1df226-85e3-4a63-bef6-b24a5ab29471 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Updating instance_info_cache with network_info: [{"id": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "address": "fa:16:3e:3e:a3:90", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ef4caf-d7", "ovs_interfaceid": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-3b98531d-34ae-4f83-930a-3c970727fac8" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:21:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:21:51 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:21:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:51 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:21:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:52 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:21:52 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:21:52 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8469MB free_disk=26.129283905029297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:21:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:21:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:21:52 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 3b98531d-34ae-4f83-930a-3c970727fac8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:21:52 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance ca38627f-4cf1-4331-b447-7e32134e3286 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:21:52 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:21:52 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:21:52 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:21:52 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:21:52 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:21:52 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:21:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:53 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:21:53 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:21:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzQlWpKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:21:54 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:21:54 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:21:54 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b33c9c-193c-48d0-bab4-881e3e68836b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:21:54 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a64ff38-2300-44d5-b3fc-87d8d9437d96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e] added
Apr 13 19:21:54 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d382df71-0b57-4061-ac09-9dba5cc0fecf]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3754276-0a62-4db1-8e4c-f0e73654614c]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzQlWpKU {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TzQlWpKU" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[229ec26a-cea0-4ca2-958f-54d89ffd29e1]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TzQlWpKU'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d248298-6e46-4039-bf12-bf8405967b63]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be6b80b-29c3-486e-8ce2-966b4c4ba555]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 19:21:54 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 19:21:54 user nova-compute[71692]:  {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:21:54 user nova-compute[71692]: WARNING os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 19:21:54 user nova-compute[71692]: 
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70c40bd-5484-4397-8a09-66aa583f3701]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e, portal: 172.16.0.220,3260]
Apr 13 19:21:54 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e, portal: 172.16.0.220,3260] successful.
Apr 13 19:21:54 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[77307c12-1fc0-4b72-8a3b-c3c0a040ea73]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e299c0e2-26d3-46fc-a651-0db0216a0481]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e (non-flash)
Apr 13 19:21:54 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e (non-flash)
Apr 13 19:21:54 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[16acdbe1-50b4-4fae-ae37-e38a0ed260cb]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:21:54 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzQlWpKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:21:55 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:21:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:21:55 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23237313233346132', 'path': '/dev/sdb'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:21:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237313233346132', 'path': '/dev/sdb'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:21:55 user nova-compute[71692]: DEBUG nova.objects.instance [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lazy-loading 'flavor' on Instance uuid 3b98531d-34ae-4f83-930a-3c970727fac8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:21:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:21:55 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:21:55 user nova-compute[71692]:   <source dev="/dev/sdb"/>
Apr 13 19:21:55 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:21:55 user nova-compute[71692]:   <serial>303df430-ed5e-409c-8be1-44341b1dbc4e</serial>
Apr 13 19:21:55 user nova-compute[71692]: </disk>
Apr 13 19:21:55 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:21:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:21:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:21:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] No VIF found with MAC fa:16:3e:3e:a3:90, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:21:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c6295acb-9672-4c1e-9d06-d9b0e2fef6eb tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "3b98531d-34ae-4f83-930a-3c970727fac8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.656s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:21:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:21:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "27bf1375-d15b-4cad-89a3-40ecc0481e27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:22:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "27bf1375-d15b-4cad-89a3-40ecc0481e27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:22:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:22:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:22:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:22:05 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:22:05 user nova-compute[71692]: INFO nova.compute.claims [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Claim successful on node user
Apr 13 19:22:06 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:22:06 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:22:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:22:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:22:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:22:06 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:22:06 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:22:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:22:06 user nova-compute[71692]: INFO nova.virt.block_device [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Booting with volume snapshot c7223586-49d3-4185-803e-366173785797 at /dev/vda
Apr 13 19:22:06 user nova-compute[71692]: DEBUG nova.policy [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:22:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:06 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Successfully created port: 8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:22:07 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Successfully updated port: 8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:22:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "refresh_cache-27bf1375-d15b-4cad-89a3-40ecc0481e27" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:22:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquired lock "refresh_cache-27bf1375-d15b-4cad-89a3-40ecc0481e27" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:22:07 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:22:07 user nova-compute[71692]: DEBUG nova.compute.manager [req-d50a664b-8c56-4a25-9e9c-a293ce8f0a20 req-0a34cc40-2143-440f-ac37-55d13c66004c service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Received event network-changed-8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:22:07 user nova-compute[71692]: DEBUG nova.compute.manager [req-d50a664b-8c56-4a25-9e9c-a293ce8f0a20 req-0a34cc40-2143-440f-ac37-55d13c66004c service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Refreshing instance network info cache due to event network-changed-8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:22:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d50a664b-8c56-4a25-9e9c-a293ce8f0a20 req-0a34cc40-2143-440f-ac37-55d13c66004c service nova] Acquiring lock "refresh_cache-27bf1375-d15b-4cad-89a3-40ecc0481e27" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:22:07 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:22:08 user nova-compute[71692]: DEBUG nova.network.neutron [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Updating instance_info_cache with network_info: [{"id": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "address": "fa:16:3e:91:ef:1c", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7fe81-e1", "ovs_interfaceid": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:22:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Releasing lock "refresh_cache-27bf1375-d15b-4cad-89a3-40ecc0481e27" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:22:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Instance network_info: |[{"id": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "address": "fa:16:3e:91:ef:1c", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7fe81-e1", "ovs_interfaceid": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:22:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d50a664b-8c56-4a25-9e9c-a293ce8f0a20 req-0a34cc40-2143-440f-ac37-55d13c66004c service nova] Acquired lock "refresh_cache-27bf1375-d15b-4cad-89a3-40ecc0481e27" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:22:08 user nova-compute[71692]: DEBUG nova.network.neutron [req-d50a664b-8c56-4a25-9e9c-a293ce8f0a20 req-0a34cc40-2143-440f-ac37-55d13c66004c service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Refreshing network info cache for port 8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:22:08 user nova-compute[71692]: DEBUG nova.network.neutron [req-d50a664b-8c56-4a25-9e9c-a293ce8f0a20 req-0a34cc40-2143-440f-ac37-55d13c66004c service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Updated VIF entry in instance network info cache for port 8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:22:08 user nova-compute[71692]: DEBUG nova.network.neutron [req-d50a664b-8c56-4a25-9e9c-a293ce8f0a20 req-0a34cc40-2143-440f-ac37-55d13c66004c service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Updating instance_info_cache with network_info: [{"id": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "address": "fa:16:3e:91:ef:1c", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7fe81-e1", "ovs_interfaceid": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:22:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d50a664b-8c56-4a25-9e9c-a293ce8f0a20 req-0a34cc40-2143-440f-ac37-55d13c66004c service nova] Releasing lock "refresh_cache-27bf1375-d15b-4cad-89a3-40ecc0481e27" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "3b98531d-34ae-4f83-930a-3c970727fac8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "3b98531d-34ae-4f83-930a-3c970727fac8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:22:11 user nova-compute[71692]: INFO nova.compute.manager [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Detaching volume 303df430-ed5e-409c-8be1-44341b1dbc4e
Apr 13 19:22:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:11 user nova-compute[71692]: INFO nova.virt.block_device [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Attempting to driver detach volume 303df430-ed5e-409c-8be1-44341b1dbc4e from mountpoint /dev/vdb
Apr 13 19:22:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Attempting to detach device vdb from instance 3b98531d-34ae-4f83-930a-3c970727fac8 from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:22:11 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:22:11 user nova-compute[71692]:   <source dev="/dev/sdb"/>
Apr 13 19:22:11 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:22:11 user nova-compute[71692]:   <serial>303df430-ed5e-409c-8be1-44341b1dbc4e</serial>
Apr 13 19:22:11 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:22:11 user nova-compute[71692]: </disk>
Apr 13 19:22:11 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:22:11 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Successfully detached device vdb from instance 3b98531d-34ae-4f83-930a-3c970727fac8 from the persistent domain config.
Apr 13 19:22:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3b98531d-34ae-4f83-930a-3c970727fac8 from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:22:11 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:22:11 user nova-compute[71692]:   <source dev="/dev/sdb"/>
Apr 13 19:22:11 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:22:11 user nova-compute[71692]:   <serial>303df430-ed5e-409c-8be1-44341b1dbc4e</serial>
Apr 13 19:22:11 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:22:11 user nova-compute[71692]: </disk>
Apr 13 19:22:11 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "3b98531d-34ae-4f83-930a-3c970727fac8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681413731.6957495, 3b98531d-34ae-4f83-930a-3c970727fac8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3b98531d-34ae-4f83-930a-3c970727fac8 {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:22:11 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Successfully detached device vdb from instance 3b98531d-34ae-4f83-930a-3c970727fac8 from the live domain config.
Apr 13 19:22:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzQlWpKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:22:11 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb4b1c0-df64-409c-840c-d11572f35875]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:22:11 user nova-compute[71692]: No targets found.
Apr 13 19:22:11 user nova-compute[71692]: iSNS:
Apr 13 19:22:11 user nova-compute[71692]: No targets found.
Apr 13 19:22:11 user nova-compute[71692]: STATIC:
Apr 13 19:22:11 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e
Apr 13 19:22:11 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:22:11 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:22:11 user nova-compute[71692]: FIRMWARE:
Apr 13 19:22:11 user nova-compute[71692]: No targets found.
Apr 13 19:22:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:22:11 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:22:11 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf94d6d1-eabf-44c1-b25b-cf522549c783]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e740acb-fab2-417e-90a9-48edcb840531]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e (non-flash)
Apr 13 19:22:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e (non-flash)
Apr 13 19:22:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc324820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e'): ({'sdb'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Removing single pathed devices sdb {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ba83e9-e173-480e-ba95-fc6d2dd40b00]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4355f18-a953-40c3-b0df-204f28bc1360]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Flushing IO for device /dev/sdb {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4373149b-554f-474f-8552-2c056e94ac5e]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82a025f-e9d3-4d19-855a-bf4f568547f9]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.utils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[893301df-8900-4398-99a0-708696122c87]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9a6a14-137b-48e3-a2e1-c51544a00de3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d048e0-7bf6-45b8-b419-054768e470bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9422a6b5-2691-4e73-aee2-18093284f198]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e, portal: 172.16.0.220,3260]
Apr 13 19:22:11 user nova-compute[71692]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e, portal: 172.16.0.220,3260] successful.
Apr 13 19:22:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7ee9c0-fbab-42e7-a731-5570246eb38f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdabbed-6102-4c1f-bf3f-85b981c834f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f7966a-b30f-471a-8ef9-61a61771002c]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] <== disconnect_volume: return (331ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:22:12 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:22:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dbf74a-d59f-4b11-ab6a-22be30dd4878]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG os_brick.utils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Updating existing volume attachment record: 1cbe43ec-ad40-4a07-beb2-b3108790f203 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG nova.objects.instance [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lazy-loading 'flavor' on Instance uuid 3b98531d-34ae-4f83-930a-3c970727fac8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-4d4b9546-bafb-4080-a3a9-5f66607b4c38 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "3b98531d-34ae-4f83-930a-3c970727fac8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.711s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "3b98531d-34ae-4f83-930a-3c970727fac8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.597s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "3b98531d-34ae-4f83-930a-3c970727fac8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "3b98531d-34ae-4f83-930a-3c970727fac8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "3b98531d-34ae-4f83-930a-3c970727fac8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:22:12 user nova-compute[71692]: INFO nova.compute.manager [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Terminating instance
Apr 13 19:22:12 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:22:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-78ad6d7f-e151-4a79-962d-9019c2e0d1e5 req-4b380eaa-e558-49fd-94b7-3d8e680bf35d service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Received event network-vif-unplugged-83ef4caf-d717-4e45-9511-cfcc225f7b05 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-78ad6d7f-e151-4a79-962d-9019c2e0d1e5 req-4b380eaa-e558-49fd-94b7-3d8e680bf35d service nova] Acquiring lock "3b98531d-34ae-4f83-930a-3c970727fac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-78ad6d7f-e151-4a79-962d-9019c2e0d1e5 req-4b380eaa-e558-49fd-94b7-3d8e680bf35d service nova] Lock "3b98531d-34ae-4f83-930a-3c970727fac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-78ad6d7f-e151-4a79-962d-9019c2e0d1e5 req-4b380eaa-e558-49fd-94b7-3d8e680bf35d service nova] Lock "3b98531d-34ae-4f83-930a-3c970727fac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-78ad6d7f-e151-4a79-962d-9019c2e0d1e5 req-4b380eaa-e558-49fd-94b7-3d8e680bf35d service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] No waiting events found dispatching network-vif-unplugged-83ef4caf-d717-4e45-9511-cfcc225f7b05 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-78ad6d7f-e151-4a79-962d-9019c2e0d1e5 req-4b380eaa-e558-49fd-94b7-3d8e680bf35d service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Received event network-vif-unplugged-83ef4caf-d717-4e45-9511-cfcc225f7b05 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:22:13 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Instance destroyed successfully.
Apr 13 19:22:13 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lazy-loading 'resources' on Instance uuid 3b98531d-34ae-4f83-930a-3c970727fac8 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:19:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-609609545',display_name='tempest-VolumesSnapshotTestJSON-instance-609609545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-609609545',id=33,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:20:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='024f13d8c179482791ed1545b6b2efd8',ramdisk_id='',reservation_id='r-tcjup60b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-613917248',owner_user_name='tempest-VolumesSnapshotTestJSON-613917248-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:20:05Z,user_data=None,user_id='789fdd98ede74e6783b667178c2689fb',uuid=3b98531d-34ae-4f83-930a-3c970727fac8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "address": "fa:16:3e:3e:a3:90", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ef4caf-d7", "ovs_interfaceid": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Converting VIF {"id": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "address": "fa:16:3e:3e:a3:90", "network": {"id": "0e855c73-cf7d-4c09-9fb5-3a4a7903b519", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-155944474-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "024f13d8c179482791ed1545b6b2efd8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83ef4caf-d7", "ovs_interfaceid": "83ef4caf-d717-4e45-9511-cfcc225f7b05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:a3:90,bridge_name='br-int',has_traffic_filtering=True,id=83ef4caf-d717-4e45-9511-cfcc225f7b05,network=Network(0e855c73-cf7d-4c09-9fb5-3a4a7903b519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83ef4caf-d7') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG os_vif [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:a3:90,bridge_name='br-int',has_traffic_filtering=True,id=83ef4caf-d717-4e45-9511-cfcc225f7b05,network=Network(0e855c73-cf7d-4c09-9fb5-3a4a7903b519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83ef4caf-d7') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83ef4caf-d7, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:22:13 user nova-compute[71692]: INFO os_vif [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:a3:90,bridge_name='br-int',has_traffic_filtering=True,id=83ef4caf-d717-4e45-9511-cfcc225f7b05,network=Network(0e855c73-cf7d-4c09-9fb5-3a4a7903b519),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83ef4caf-d7')
Apr 13 19:22:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:303df430-ed5e-409c-8be1-44341b1dbc4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TzQlWpKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:22:13 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:22:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[9198c654-037c-4012-aa7c-82bcfff2c207]: Unexpected error while running command.
Apr 13 19:22:13 user nova-compute[71692]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 19:22:13 user nova-compute[71692]: Exit code: 21
Apr 13 19:22:13 user nova-compute[71692]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 19:22:13 user nova-compute[71692]: Stderr: '' {{(pid=82243) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 13 19:22:13 user nova-compute[71692]: Traceback (most recent call last):
Apr 13 19:22:13 user nova-compute[71692]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 13 19:22:13 user nova-compute[71692]:     ret = func(*f_args, **f_kwargs)
Apr 13 19:22:13 user nova-compute[71692]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 13 19:22:13 user nova-compute[71692]:     return func(*args, **kwargs)
Apr 13 19:22:13 user nova-compute[71692]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 13 19:22:13 user nova-compute[71692]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 13 19:22:13 user nova-compute[71692]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 13 19:22:13 user nova-compute[71692]:     return putils.execute(on_execute=on_execute,
Apr 13 19:22:13 user nova-compute[71692]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 13 19:22:13 user nova-compute[71692]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 13 19:22:13 user nova-compute[71692]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 13 19:22:13 user nova-compute[71692]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 19:22:13 user nova-compute[71692]: Exit code: 21
Apr 13 19:22:13 user nova-compute[71692]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 19:22:13 user nova-compute[71692]: Stderr: ''
Apr 13 19:22:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9198c654-037c-4012-aa7c-82bcfff2c207]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 13 19:22:13 user nova-compute[71692]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 19:22:13 user nova-compute[71692]: Exit code: 21
Apr 13 19:22:13 user nova-compute[71692]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 19:22:13 user nova-compute[71692]: Stderr: ''
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 13 19:22:13 user nova-compute[71692]: ERROR os_brick.initiator.connectors.iscsi 
Apr 13 19:22:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71692) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.032s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] <== disconnect_volume: return (32ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:22:13 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Deleting instance files /opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8_del
Apr 13 19:22:13 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Deletion of /opt/stack/data/nova/instances/3b98531d-34ae-4f83-930a-3c970727fac8_del complete
Apr 13 19:22:13 user nova-compute[71692]: INFO nova.compute.manager [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 13 19:22:13 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:22:13 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:22:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:14 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:22:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-32b7c781-dd32-46e4-8f82-ee3de6039699 req-279a534e-a30a-4aa7-b9b3-ddcea20c74ad service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Received event network-vif-deleted-83ef4caf-d717-4e45-9511-cfcc225f7b05 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:22:14 user nova-compute[71692]: INFO nova.compute.manager [req-32b7c781-dd32-46e4-8f82-ee3de6039699 req-279a534e-a30a-4aa7-b9b3-ddcea20c74ad service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Neutron deleted interface 83ef4caf-d717-4e45-9511-cfcc225f7b05; detaching it from the instance and deleting it from the info cache
Apr 13 19:22:14 user nova-compute[71692]: DEBUG nova.network.neutron [req-32b7c781-dd32-46e4-8f82-ee3de6039699 req-279a534e-a30a-4aa7-b9b3-ddcea20c74ad service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:22:14 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Took 1.08 seconds to deallocate network for instance.
Apr 13 19:22:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-32b7c781-dd32-46e4-8f82-ee3de6039699 req-279a534e-a30a-4aa7-b9b3-ddcea20c74ad service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Detach interface failed, port_id=83ef4caf-d717-4e45-9511-cfcc225f7b05, reason: Instance 3b98531d-34ae-4f83-930a-3c970727fac8 could not be found. {{(pid=71692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 19:22:14 user nova-compute[71692]: WARNING nova.volume.cinder [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Attachment 9a1df226-85e3-4a63-bef6-b24a5ab29471 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9a1df226-85e3-4a63-bef6-b24a5ab29471. (HTTP 404) (Request-ID: req-e3fc5757-995a-4c91-b666-2d6a6429716e)
Apr 13 19:22:14 user nova-compute[71692]: INFO nova.compute.manager [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Took 0.04 seconds to detach 1 volumes for instance.
Apr 13 19:22:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:22:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:22:15 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:22:15 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:22:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:22:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-b6fd41e0-d0f9-45db-a2c9-a9ac504c1560 req-daeb7906-3201-4aff-b4d7-070d27bb9c6c service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Received event network-vif-plugged-83ef4caf-d717-4e45-9511-cfcc225f7b05 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:22:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b6fd41e0-d0f9-45db-a2c9-a9ac504c1560 req-daeb7906-3201-4aff-b4d7-070d27bb9c6c service nova] Acquiring lock "3b98531d-34ae-4f83-930a-3c970727fac8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:22:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b6fd41e0-d0f9-45db-a2c9-a9ac504c1560 req-daeb7906-3201-4aff-b4d7-070d27bb9c6c service nova] Lock "3b98531d-34ae-4f83-930a-3c970727fac8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:22:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b6fd41e0-d0f9-45db-a2c9-a9ac504c1560 req-daeb7906-3201-4aff-b4d7-070d27bb9c6c service nova] Lock "3b98531d-34ae-4f83-930a-3c970727fac8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:22:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-b6fd41e0-d0f9-45db-a2c9-a9ac504c1560 req-daeb7906-3201-4aff-b4d7-070d27bb9c6c service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] No waiting events found dispatching network-vif-plugged-83ef4caf-d717-4e45-9511-cfcc225f7b05 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:22:15 user nova-compute[71692]: WARNING nova.compute.manager [req-b6fd41e0-d0f9-45db-a2c9-a9ac504c1560 req-daeb7906-3201-4aff-b4d7-070d27bb9c6c service nova] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Received unexpected event network-vif-plugged-83ef4caf-d717-4e45-9511-cfcc225f7b05 for instance with vm_state deleted and task_state None.
Apr 13 19:22:15 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Deleted allocations for instance 3b98531d-34ae-4f83-930a-3c970727fac8
Apr 13 19:22:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e86faa25-0705-4e22-9b5b-6a17191b01b4 tempest-VolumesSnapshotTestJSON-613917248 tempest-VolumesSnapshotTestJSON-613917248-project-member] Lock "3b98531d-34ae-4f83-930a-3c970727fac8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.379s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:22:17 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Creating image(s)
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Did not create local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Ensure instance console log exists: /opt/stack/data/nova/instances/27bf1375-d15b-4cad-89a3-40ecc0481e27/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Start _get_guest_xml network_info=[{"id": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "address": "fa:16:3e:91:ef:1c", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7fe81-e1", "ovs_interfaceid": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '1cbe43ec-ad40-4a07-beb2-b3108790f203', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oIhmntVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '27bf1375-d15b-4cad-89a3-40ecc0481e27', 'attached_at': '', 'detached_at': '', 'volume_id': '960d18d0-fc43-4852-895c-e4c4920c379b', 'serial': '960d18d0-fc43-4852-895c-e4c4920c379b'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:22:17 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:22:17 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oIhmntVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:22:17 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:22:17 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:22:17 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec0fb19-02ee-451c-ac5a-819748deee9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:22:17 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd5b52e-52ee-4037-83dd-e9a451816169]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b] added
Apr 13 19:22:17 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b142fe-b2f4-43c0-9410-0fdf0ea77011]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0497831-6234-47cf-9dbf-74b481e89fbe]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oIhmntVa {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oIhmntVa" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4ae37e-da11-4cc9-9244-4a0590e2ec6b]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oIhmntVa'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[52af45c9-d8c5-4526-9767-c38403342aad]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece09bdf-17e2-4fec-af2c-1980e607ffe1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 19:22:17 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 19:22:17 user nova-compute[71692]:  {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:22:17 user nova-compute[71692]: WARNING os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 19:22:17 user nova-compute[71692]: 
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8a9334-f089-4f16-b08a-41b75b6024bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b, portal: 172.16.0.220,3260]
Apr 13 19:22:17 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b, portal: 172.16.0.220,3260] successful.
Apr 13 19:22:17 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d95f58-5620-41e7-9d4d-3d67ff5dc3af]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32f3fc4-7ecd-4339-83e3-a520d01c0a4a]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b (non-flash)
Apr 13 19:22:17 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b (non-flash)
Apr 13 19:22:17 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7afee62-ac4d-4db6-b84f-3cfbacd4b540]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:22:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oIhmntVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23835313433303337', 'path': '/dev/sdb'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835313433303337', 'path': '/dev/sdb'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-70568586',display_name='tempest-TestVolumeBootPattern-server-70568586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-70568586',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-ldsvy5ga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:22:06Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=27bf1375-d15b-4cad-89a3-40ecc0481e27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "address": "fa:16:3e:91:ef:1c", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7fe81-e1", "ovs_interfaceid": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "address": "fa:16:3e:91:ef:1c", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7fe81-e1", "ovs_interfaceid": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:ef:1c,bridge_name='br-int',has_traffic_filtering=True,id=8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee7fe81-e1') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG nova.objects.instance [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lazy-loading 'pci_devices' on Instance uuid 27bf1375-d15b-4cad-89a3-40ecc0481e27 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:22:18 user nova-compute[71692]:   <uuid>27bf1375-d15b-4cad-89a3-40ecc0481e27</uuid>
Apr 13 19:22:18 user nova-compute[71692]:   <name>instance-00000024</name>
Apr 13 19:22:18 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:22:18 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:22:18 user nova-compute[71692]:   <metadata>
Apr 13 19:22:18 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:22:18 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:22:18 user nova-compute[71692]:       <nova:name>tempest-TestVolumeBootPattern-server-70568586</nova:name>
Apr 13 19:22:18 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:22:17</nova:creationTime>
Apr 13 19:22:18 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:22:18 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:22:18 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:22:18 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:22:18 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:22:18 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:22:18 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:22:18 user nova-compute[71692]:       <nova:owner>
Apr 13 19:22:18 user nova-compute[71692]:         <nova:user uuid="526d9c809b81418d89da662f973a1bdc">tempest-TestVolumeBootPattern-1717000141-project-member</nova:user>
Apr 13 19:22:18 user nova-compute[71692]:         <nova:project uuid="a5231d999e51417ebe91927707bfd2bd">tempest-TestVolumeBootPattern-1717000141</nova:project>
Apr 13 19:22:18 user nova-compute[71692]:       </nova:owner>
Apr 13 19:22:18 user nova-compute[71692]:       <nova:ports>
Apr 13 19:22:18 user nova-compute[71692]:         <nova:port uuid="8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b">
Apr 13 19:22:18 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 19:22:18 user nova-compute[71692]:         </nova:port>
Apr 13 19:22:18 user nova-compute[71692]:       </nova:ports>
Apr 13 19:22:18 user nova-compute[71692]:     </nova:instance>
Apr 13 19:22:18 user nova-compute[71692]:   </metadata>
Apr 13 19:22:18 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:22:18 user nova-compute[71692]:     <system>
Apr 13 19:22:18 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:22:18 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:22:18 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:22:18 user nova-compute[71692]:       <entry name="serial">27bf1375-d15b-4cad-89a3-40ecc0481e27</entry>
Apr 13 19:22:18 user nova-compute[71692]:       <entry name="uuid">27bf1375-d15b-4cad-89a3-40ecc0481e27</entry>
Apr 13 19:22:18 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:22:18 user nova-compute[71692]:     </system>
Apr 13 19:22:18 user nova-compute[71692]:   </sysinfo>
Apr 13 19:22:18 user nova-compute[71692]:   <os>
Apr 13 19:22:18 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:22:18 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:22:18 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:22:18 user nova-compute[71692]:   </os>
Apr 13 19:22:18 user nova-compute[71692]:   <features>
Apr 13 19:22:18 user nova-compute[71692]:     <acpi/>
Apr 13 19:22:18 user nova-compute[71692]:     <apic/>
Apr 13 19:22:18 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:22:18 user nova-compute[71692]:   </features>
Apr 13 19:22:18 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:22:18 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:22:18 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:22:18 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:22:18 user nova-compute[71692]:   </clock>
Apr 13 19:22:18 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:22:18 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:22:18 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:22:18 user nova-compute[71692]:   </cpu>
Apr 13 19:22:18 user nova-compute[71692]:   <devices>
Apr 13 19:22:18 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:22:18 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:22:18 user nova-compute[71692]:       <source dev="/dev/sdb"/>
Apr 13 19:22:18 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:22:18 user nova-compute[71692]:       <serial>960d18d0-fc43-4852-895c-e4c4920c379b</serial>
Apr 13 19:22:18 user nova-compute[71692]:     </disk>
Apr 13 19:22:18 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:22:18 user nova-compute[71692]:       <mac address="fa:16:3e:91:ef:1c"/>
Apr 13 19:22:18 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:22:18 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:22:18 user nova-compute[71692]:       <target dev="tap8ee7fe81-e1"/>
Apr 13 19:22:18 user nova-compute[71692]:     </interface>
Apr 13 19:22:18 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:22:18 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/27bf1375-d15b-4cad-89a3-40ecc0481e27/console.log" append="off"/>
Apr 13 19:22:18 user nova-compute[71692]:     </serial>
Apr 13 19:22:18 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:22:18 user nova-compute[71692]:     <video>
Apr 13 19:22:18 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:22:18 user nova-compute[71692]:     </video>
Apr 13 19:22:18 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:22:18 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:22:18 user nova-compute[71692]:     </rng>
Apr 13 19:22:18 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:22:18 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:22:18 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:22:18 user nova-compute[71692]:     </memballoon>
Apr 13 19:22:18 user nova-compute[71692]:   </devices>
Apr 13 19:22:18 user nova-compute[71692]: </domain>
Apr 13 19:22:18 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-70568586',display_name='tempest-TestVolumeBootPattern-server-70568586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-70568586',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-ldsvy5ga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:22:06Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=27bf1375-d15b-4cad-89a3-40ecc0481e27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "address": "fa:16:3e:91:ef:1c", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7fe81-e1", "ovs_interfaceid": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "address": "fa:16:3e:91:ef:1c", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7fe81-e1", "ovs_interfaceid": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:ef:1c,bridge_name='br-int',has_traffic_filtering=True,id=8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee7fe81-e1') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG os_vif [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:ef:1c,bridge_name='br-int',has_traffic_filtering=True,id=8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee7fe81-e1') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ee7fe81-e1, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ee7fe81-e1, col_values=(('external_ids', {'iface-id': '8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:ef:1c', 'vm-uuid': '27bf1375-d15b-4cad-89a3-40ecc0481e27'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:18 user nova-compute[71692]: INFO os_vif [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:ef:1c,bridge_name='br-int',has_traffic_filtering=True,id=8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee7fe81-e1')
Apr 13 19:22:18 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:22:18 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] No VIF found with MAC fa:16:3e:91:ef:1c, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:22:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:19 user nova-compute[71692]: DEBUG nova.compute.manager [req-ab8d1dcb-c710-4075-a011-1d110e828e28 req-36e0da4b-da25-473f-882a-8f3ec13b0a65 service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Received event network-vif-plugged-8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:22:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ab8d1dcb-c710-4075-a011-1d110e828e28 req-36e0da4b-da25-473f-882a-8f3ec13b0a65 service nova] Acquiring lock "27bf1375-d15b-4cad-89a3-40ecc0481e27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:22:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ab8d1dcb-c710-4075-a011-1d110e828e28 req-36e0da4b-da25-473f-882a-8f3ec13b0a65 service nova] Lock "27bf1375-d15b-4cad-89a3-40ecc0481e27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:22:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ab8d1dcb-c710-4075-a011-1d110e828e28 req-36e0da4b-da25-473f-882a-8f3ec13b0a65 service nova] Lock "27bf1375-d15b-4cad-89a3-40ecc0481e27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:22:19 user nova-compute[71692]: DEBUG nova.compute.manager [req-ab8d1dcb-c710-4075-a011-1d110e828e28 req-36e0da4b-da25-473f-882a-8f3ec13b0a65 service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] No waiting events found dispatching network-vif-plugged-8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:22:19 user nova-compute[71692]: WARNING nova.compute.manager [req-ab8d1dcb-c710-4075-a011-1d110e828e28 req-36e0da4b-da25-473f-882a-8f3ec13b0a65 service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Received unexpected event network-vif-plugged-8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b for instance with vm_state building and task_state spawning.
Apr 13 19:22:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:21 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413741.8603654, 27bf1375-d15b-4cad-89a3-40ecc0481e27 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:22:21 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] VM Resumed (Lifecycle Event)
Apr 13 19:22:21 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:22:21 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:22:21 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Instance spawned successfully.
Apr 13 19:22:21 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:22:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:21 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:22:21 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:22:21 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:22:21 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:22:21 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:22:21 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:22:21 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:22:21 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:22:21 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:22:21 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413741.8621764, 27bf1375-d15b-4cad-89a3-40ecc0481e27 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:22:21 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] VM Started (Lifecycle Event)
Apr 13 19:22:21 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:22:21 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:22:21 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:22:21 user nova-compute[71692]: INFO nova.compute.manager [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Took 4.91 seconds to spawn the instance on the hypervisor.
Apr 13 19:22:21 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:22:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-8b463977-3764-4009-bdb9-4f06bce890fa req-aa55906a-cec8-44d6-8a15-9c058f32a46b service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Received event network-vif-plugged-8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:22:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8b463977-3764-4009-bdb9-4f06bce890fa req-aa55906a-cec8-44d6-8a15-9c058f32a46b service nova] Acquiring lock "27bf1375-d15b-4cad-89a3-40ecc0481e27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:22:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8b463977-3764-4009-bdb9-4f06bce890fa req-aa55906a-cec8-44d6-8a15-9c058f32a46b service nova] Lock "27bf1375-d15b-4cad-89a3-40ecc0481e27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:22:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8b463977-3764-4009-bdb9-4f06bce890fa req-aa55906a-cec8-44d6-8a15-9c058f32a46b service nova] Lock "27bf1375-d15b-4cad-89a3-40ecc0481e27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:22:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-8b463977-3764-4009-bdb9-4f06bce890fa req-aa55906a-cec8-44d6-8a15-9c058f32a46b service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] No waiting events found dispatching network-vif-plugged-8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:22:22 user nova-compute[71692]: WARNING nova.compute.manager [req-8b463977-3764-4009-bdb9-4f06bce890fa req-aa55906a-cec8-44d6-8a15-9c058f32a46b service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Received unexpected event network-vif-plugged-8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b for instance with vm_state building and task_state spawning.
Apr 13 19:22:22 user nova-compute[71692]: INFO nova.compute.manager [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Took 16.21 seconds to build instance.
Apr 13 19:22:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f6662a1d-c96b-48f7-be2e-9fa57427464e tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "27bf1375-d15b-4cad-89a3-40ecc0481e27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.303s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:22:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:28 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413733.6059728, 3b98531d-34ae-4f83-930a-3c970727fac8 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:22:28 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] VM Stopped (Lifecycle Event)
Apr 13 19:22:28 user nova-compute[71692]: DEBUG nova.compute.manager [None req-832ead30-3777-4806-b454-49d11893ead0 None None] [instance: 3b98531d-34ae-4f83-930a-3c970727fac8] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:22:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:47 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:22:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:50 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:22:50 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:22:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-ca38627f-4cf1-4331-b447-7e32134e3286" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:22:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-ca38627f-4cf1-4331-b447-7e32134e3286" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:22:50 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:22:50 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Updating instance_info_cache with network_info: [{"id": "f9b73165-75e2-47ed-a836-d0704aa5788d", "address": "fa:16:3e:0b:98:c2", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b73165-75", "ovs_interfaceid": "f9b73165-75e2-47ed-a836-d0704aa5788d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:22:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-ca38627f-4cf1-4331-b447-7e32134e3286" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:22:50 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:22:50 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:22:50 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:22:51 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:22:51 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:22:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:52 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:22:52 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:22:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:22:53 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:22:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:22:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:22:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:22:53 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:22:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:22:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:22:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:22:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:22:54 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:22:54 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:22:54 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8472MB free_disk=26.125167846679688GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance ca38627f-4cf1-4331-b447-7e32134e3286 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing inventories for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating ProviderTree inventory for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating inventory in ProviderTree for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing aggregate associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, aggregates: None {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing trait associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:22:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 19:22:57 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:22:57 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:22:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:03 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:23:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 19:23:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] There are 0 instances to clean {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 19:23:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-0f7b045e-d1ce-4b6f-a9d2-5bf1f98622f2 req-9d31735a-d9b1-4e8d-9599-509600208ea4 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Received event network-changed-f9b73165-75e2-47ed-a836-d0704aa5788d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:23:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-0f7b045e-d1ce-4b6f-a9d2-5bf1f98622f2 req-9d31735a-d9b1-4e8d-9599-509600208ea4 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Refreshing instance network info cache due to event network-changed-f9b73165-75e2-47ed-a836-d0704aa5788d. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:23:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0f7b045e-d1ce-4b6f-a9d2-5bf1f98622f2 req-9d31735a-d9b1-4e8d-9599-509600208ea4 service nova] Acquiring lock "refresh_cache-ca38627f-4cf1-4331-b447-7e32134e3286" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:23:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0f7b045e-d1ce-4b6f-a9d2-5bf1f98622f2 req-9d31735a-d9b1-4e8d-9599-509600208ea4 service nova] Acquired lock "refresh_cache-ca38627f-4cf1-4331-b447-7e32134e3286" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:23:04 user nova-compute[71692]: DEBUG nova.network.neutron [req-0f7b045e-d1ce-4b6f-a9d2-5bf1f98622f2 req-9d31735a-d9b1-4e8d-9599-509600208ea4 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Refreshing network info cache for port f9b73165-75e2-47ed-a836-d0704aa5788d {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:23:05 user nova-compute[71692]: DEBUG nova.network.neutron [req-0f7b045e-d1ce-4b6f-a9d2-5bf1f98622f2 req-9d31735a-d9b1-4e8d-9599-509600208ea4 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Updated VIF entry in instance network info cache for port f9b73165-75e2-47ed-a836-d0704aa5788d. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:23:05 user nova-compute[71692]: DEBUG nova.network.neutron [req-0f7b045e-d1ce-4b6f-a9d2-5bf1f98622f2 req-9d31735a-d9b1-4e8d-9599-509600208ea4 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Updating instance_info_cache with network_info: [{"id": "f9b73165-75e2-47ed-a836-d0704aa5788d", "address": "fa:16:3e:0b:98:c2", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b73165-75", "ovs_interfaceid": "f9b73165-75e2-47ed-a836-d0704aa5788d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:23:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0f7b045e-d1ce-4b6f-a9d2-5bf1f98622f2 req-9d31735a-d9b1-4e8d-9599-509600208ea4 service nova] Releasing lock "refresh_cache-ca38627f-4cf1-4331-b447-7e32134e3286" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:23:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "ca38627f-4cf1-4331-b447-7e32134e3286" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ca38627f-4cf1-4331-b447-7e32134e3286" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG nova.objects.instance [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'flavor' on Instance uuid ca38627f-4cf1-4331-b447-7e32134e3286 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ca38627f-4cf1-4331-b447-7e32134e3286" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "ca38627f-4cf1-4331-b447-7e32134e3286" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ca38627f-4cf1-4331-b447-7e32134e3286" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:23:06 user nova-compute[71692]: INFO nova.compute.manager [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Attaching volume b8096855-aac7-49c4-834c-a0ec2d99e7a7 to /dev/vdb
Apr 13 19:23:06 user nova-compute[71692]: DEBUG os_brick.utils [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19cae46-daeb-4724-a1df-4add6339f761]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3978ec3-844f-48c4-b4c1-4420e4842eed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2de30e0-0484-4aaf-a1e6-49b362cd76e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35480ae-a71b-4480-aa38-e2939853e9d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:23:06 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:23:06 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2f703e-71cf-453b-bda6-e83075811295]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG os_brick.utils [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Updating existing volume attachment record: 4261379b-429c-44d9-aee7-28aef45caf95 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:23:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZxRaojqJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:23:10 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:23:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:23:10 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:23:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:23:10 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2d3e66-53f0-4c43-be1d-31eeea567cee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:23:10 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee1da43-a03c-4218-a0b2-5e1796401b90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7] added
Apr 13 19:23:10 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8746d886-e704-412e-9f54-832103a64dfa]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4496df99-0759-4a27-8654-808977ed7dc2]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZxRaojqJ {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZxRaojqJ" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[15da041b-1147-46d0-a137-4f52d8ceb990]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZxRaojqJ'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21d25e7-f5fb-4402-ae21-78ed337f95f7]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f354537-fb14-42d3-9a14-0fe9981b1cde]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b (non-flash)
Apr 13 19:23:10 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b (non-flash)
Apr 13 19:23:10 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ab6385-f319-4312-b48c-f65deca78723]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7, portal: 172.16.0.220,3260]
Apr 13 19:23:10 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7, portal: 172.16.0.220,3260] successful.
Apr 13 19:23:10 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba072fa7-9bbe-477a-b89a-427e9b96bb23]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:23:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5fba55-65e7-4b00-aa62-c10e0905ded5]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b (non-flash)
Apr 13 19:23:11 user nova-compute[71692]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 (non-flash)
Apr 13 19:23:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:23:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b (non-flash)
Apr 13 19:23:11 user nova-compute[71692]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 (non-flash)
Apr 13 19:23:11 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:23:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:23:11 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:23:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:23:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:23:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:11 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fef29f1-a0b3-4693-ac3d-82128dada0a1]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:11 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:23:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:12 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:23:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZxRaojqJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:23:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:23:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26237363361306662', 'path': '/dev/sdc'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:23:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237363361306662', 'path': '/dev/sdc'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:23:12 user nova-compute[71692]: DEBUG nova.objects.instance [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'flavor' on Instance uuid ca38627f-4cf1-4331-b447-7e32134e3286 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:23:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:23:12 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:23:12 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:23:12 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:23:12 user nova-compute[71692]:   <serial>b8096855-aac7-49c4-834c-a0ec2d99e7a7</serial>
Apr 13 19:23:12 user nova-compute[71692]: </disk>
Apr 13 19:23:12 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:23:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:23:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:23:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] No VIF found with MAC fa:16:3e:0b:98:c2, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:23:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2122c49c-131c-4ec1-a79b-659c8992973c tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ca38627f-4cf1-4331-b447-7e32134e3286" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.329s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "ca38627f-4cf1-4331-b447-7e32134e3286" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ca38627f-4cf1-4331-b447-7e32134e3286" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:23:13 user nova-compute[71692]: INFO nova.compute.manager [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Detaching volume b8096855-aac7-49c4-834c-a0ec2d99e7a7
Apr 13 19:23:13 user nova-compute[71692]: INFO nova.virt.block_device [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Attempting to driver detach volume b8096855-aac7-49c4-834c-a0ec2d99e7a7 from mountpoint /dev/vdb
Apr 13 19:23:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Attempting to detach device vdb from instance ca38627f-4cf1-4331-b447-7e32134e3286 from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:23:13 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:23:13 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:23:13 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:23:13 user nova-compute[71692]:   <serial>b8096855-aac7-49c4-834c-a0ec2d99e7a7</serial>
Apr 13 19:23:13 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:23:13 user nova-compute[71692]: </disk>
Apr 13 19:23:13 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:23:13 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Successfully detached device vdb from instance ca38627f-4cf1-4331-b447-7e32134e3286 from the persistent domain config.
Apr 13 19:23:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ca38627f-4cf1-4331-b447-7e32134e3286 from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:23:13 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:23:13 user nova-compute[71692]:   <source dev="/dev/sdc"/>
Apr 13 19:23:13 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:23:13 user nova-compute[71692]:   <serial>b8096855-aac7-49c4-834c-a0ec2d99e7a7</serial>
Apr 13 19:23:13 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:23:13 user nova-compute[71692]: </disk>
Apr 13 19:23:13 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681413793.6278617, ca38627f-4cf1-4331-b447-7e32134e3286 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ca38627f-4cf1-4331-b447-7e32134e3286 {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:23:13 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Successfully detached device vdb from instance ca38627f-4cf1-4331-b447-7e32134e3286 from the live domain config.
Apr 13 19:23:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZxRaojqJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:23:13 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2198697-8a43-4b55-b86e-049ad141420f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:23:13 user nova-compute[71692]: No targets found.
Apr 13 19:23:13 user nova-compute[71692]: iSNS:
Apr 13 19:23:13 user nova-compute[71692]: No targets found.
Apr 13 19:23:13 user nova-compute[71692]: STATIC:
Apr 13 19:23:13 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b
Apr 13 19:23:13 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:23:13 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:23:13 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7
Apr 13 19:23:13 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:23:13 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:23:13 user nova-compute[71692]: FIRMWARE:
Apr 13 19:23:13 user nova-compute[71692]: No targets found.
Apr 13 19:23:13 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:23:13 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:23:13 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92179aa-765a-4fbe-aca7-70bebab1ab04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e777e3-5d55-4859-b46b-696c572f02aa]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b (non-flash)
Apr 13 19:23:13 user nova-compute[71692]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 (non-flash)
Apr 13 19:23:13 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b (non-flash)
Apr 13 19:23:13 user nova-compute[71692]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 (non-flash)
Apr 13 19:23:13 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc2103a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7'): ({'sdc'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Removing single pathed devices sdc {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[11011fcf-5927-4aaa-b858-dcd452412d30]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fb2337-3101-4c2f-bd00-6750b9630880]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Flushing IO for device /dev/sdc {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f48e867-62b7-4c12-81e2-946533ce6a4d]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b292404-a52a-44e3-a623-d9c9b216c116]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4bd920-54ff-4e24-b23f-44faf68d3cee]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a7aaeb-b879-4308-9c50-a267ad331a44]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7, portal: 172.16.0.220,3260]
Apr 13 19:23:13 user nova-compute[71692]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7, portal: 172.16.0.220,3260] successful.
Apr 13 19:23:13 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8096855-aac7-49c4-834c-a0ec2d99e7a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[481e7ed1-9194-42e2-af7d-d4cc30e0c7c6]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] <== disconnect_volume: return (335ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:23:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:23:14 user nova-compute[71692]: DEBUG nova.objects.instance [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'flavor' on Instance uuid ca38627f-4cf1-4331-b447-7e32134e3286 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:23:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1f51b305-e923-421c-a092-d99cd58cfae0 tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ca38627f-4cf1-4331-b447-7e32134e3286" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.637s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:23:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:23:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:23:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:23:29 user nova-compute[71692]: INFO nova.compute.manager [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] instance snapshotting
Apr 13 19:23:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Beginning live snapshot process
Apr 13 19:23:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json -f qcow2 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:29 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json -f qcow2 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json -f qcow2" returned: 0 in 0.156s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.138s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5hlpjy52/93f0714665a5452fb2ddbbbec30e2099.delta 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5hlpjy52/93f0714665a5452fb2ddbbbec30e2099.delta 1073741824" returned: 0 in 0.058s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:30 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 19:23:30 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] COPY block job progress, current cursor: 65536 final cursor: 43778048 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 19:23:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 19:23:31 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 19:23:31 user nova-compute[71692]: DEBUG nova.privsep.utils [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 19:23:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5hlpjy52/93f0714665a5452fb2ddbbbec30e2099.delta /opt/stack/data/nova/instances/snapshots/tmp5hlpjy52/93f0714665a5452fb2ddbbbec30e2099 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5hlpjy52/93f0714665a5452fb2ddbbbec30e2099.delta /opt/stack/data/nova/instances/snapshots/tmp5hlpjy52/93f0714665a5452fb2ddbbbec30e2099" returned: 0 in 0.523s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:32 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Snapshot extracted, beginning image upload
Apr 13 19:23:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:34 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Snapshot image upload complete
Apr 13 19:23:34 user nova-compute[71692]: INFO nova.compute.manager [None req-74e780d7-913a-4e01-adae-00c1ac157954 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Took 5.31 seconds to snapshot the instance on the hypervisor.
Apr 13 19:23:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:23:48 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:23:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:50 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:23:51 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:23:51 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:23:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:23:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:23:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:23:51 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:23:51 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updating instance_info_cache with network_info: [{"id": "5bd81344-f669-49c6-897f-97510d86e77b", "address": "fa:16:3e:01:0c:f9", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd81344-f6", "ovs_interfaceid": "5bd81344-f669-49c6-897f-97510d86e77b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:23:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:23:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:23:51 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:23:52 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:23:53 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:23:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:23:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:23:54 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:23:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:23:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:23:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:23:54 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:23:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:23:55 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:23:55 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:23:55 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8534MB free_disk=26.078205108642578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:23:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:23:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:23:55 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance ca38627f-4cf1-4331-b447-7e32134e3286 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:23:55 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:23:55 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 27bf1375-d15b-4cad-89a3-40ecc0481e27 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:23:55 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:23:55 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:23:55 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:23:55 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:23:55 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:23:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:23:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "27bf1375-d15b-4cad-89a3-40ecc0481e27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:23:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "27bf1375-d15b-4cad-89a3-40ecc0481e27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:23:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "27bf1375-d15b-4cad-89a3-40ecc0481e27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:23:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "27bf1375-d15b-4cad-89a3-40ecc0481e27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:23:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "27bf1375-d15b-4cad-89a3-40ecc0481e27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:23:56 user nova-compute[71692]: INFO nova.compute.manager [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Terminating instance
Apr 13 19:23:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:23:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-dc9b089f-b4ae-4e07-b8cf-4c6fe45098ca req-61551d80-f084-4f1a-8f59-d9fd4d588aeb service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Received event network-vif-unplugged-8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:23:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dc9b089f-b4ae-4e07-b8cf-4c6fe45098ca req-61551d80-f084-4f1a-8f59-d9fd4d588aeb service nova] Acquiring lock "27bf1375-d15b-4cad-89a3-40ecc0481e27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:23:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dc9b089f-b4ae-4e07-b8cf-4c6fe45098ca req-61551d80-f084-4f1a-8f59-d9fd4d588aeb service nova] Lock "27bf1375-d15b-4cad-89a3-40ecc0481e27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:23:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dc9b089f-b4ae-4e07-b8cf-4c6fe45098ca req-61551d80-f084-4f1a-8f59-d9fd4d588aeb service nova] Lock "27bf1375-d15b-4cad-89a3-40ecc0481e27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:23:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-dc9b089f-b4ae-4e07-b8cf-4c6fe45098ca req-61551d80-f084-4f1a-8f59-d9fd4d588aeb service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] No waiting events found dispatching network-vif-unplugged-8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:23:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-dc9b089f-b4ae-4e07-b8cf-4c6fe45098ca req-61551d80-f084-4f1a-8f59-d9fd4d588aeb service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Received event network-vif-unplugged-8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:23:57 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Instance destroyed successfully.
Apr 13 19:23:57 user nova-compute[71692]: DEBUG nova.objects.instance [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lazy-loading 'resources' on Instance uuid 27bf1375-d15b-4cad-89a3-40ecc0481e27 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:22:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-70568586',display_name='tempest-TestVolumeBootPattern-server-70568586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-70568586',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:22:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-ldsvy5ga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:22:22Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=27bf1375-d15b-4cad-89a3-40ecc0481e27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "address": "fa:16:3e:91:ef:1c", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7fe81-e1", "ovs_interfaceid": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "address": "fa:16:3e:91:ef:1c", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee7fe81-e1", "ovs_interfaceid": "8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:ef:1c,bridge_name='br-int',has_traffic_filtering=True,id=8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee7fe81-e1') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_vif [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:ef:1c,bridge_name='br-int',has_traffic_filtering=True,id=8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee7fe81-e1') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ee7fe81-e1, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:23:57 user nova-compute[71692]: INFO os_vif [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:ef:1c,bridge_name='br-int',has_traffic_filtering=True,id=8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee7fe81-e1')
Apr 13 19:23:57 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oIhmntVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:23:57 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2295a01b-84c7-4be4-b720-f1b6c866b2f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:23:57 user nova-compute[71692]: No targets found.
Apr 13 19:23:57 user nova-compute[71692]: iSNS:
Apr 13 19:23:57 user nova-compute[71692]: No targets found.
Apr 13 19:23:57 user nova-compute[71692]: STATIC:
Apr 13 19:23:57 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b
Apr 13 19:23:57 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:23:57 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:23:57 user nova-compute[71692]: FIRMWARE:
Apr 13 19:23:57 user nova-compute[71692]: No targets found.
Apr 13 19:23:57 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:23:57 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:23:57 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dea1aa9-0f81-427a-bf75-ff383aa7906f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[123380bb-62f5-4515-b298-167e266680c8]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b (non-flash)
Apr 13 19:23:57 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b (non-flash)
Apr 13 19:23:57 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febd4ab30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b'): ({'sdb'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Removing single pathed devices sdb {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb6d192-c7ec-405d-a967-75ef8a93ac1e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3947e5dc-dc8c-46a2-abde-77459f676123]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flushing IO for device /dev/sdb {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75d82b5-d8de-48e3-988c-d15aac86cfe7]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9408afba-5958-4bf3-b64b-7a46ca464969]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23835313433303337', '/dev/disk/by-id/scsi-1SCST_BIO1fba75a1-8514303770a934bc', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1fba75a1') {{(pid=82243) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10c932b-d955-4fa3-a850-0e8da168aa17]: (4, None) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb1ab88-ccc4-4bb3-be5f-b087b556300d]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1bc615-18f1-4521-8ce8-7de62904b26a]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b, portal: 172.16.0.220,3260]
Apr 13 19:23:57 user nova-compute[71692]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b, portal: 172.16.0.220,3260] successful.
Apr 13 19:23:57 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:960d18d0-fc43-4852-895c-e4c4920c379b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffefd6e-53e2-4a33-8a10-9adc0423d2ee]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== disconnect_volume: return (303ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:23:57 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Deleting instance files /opt/stack/data/nova/instances/27bf1375-d15b-4cad-89a3-40ecc0481e27_del
Apr 13 19:23:57 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Deletion of /opt/stack/data/nova/instances/27bf1375-d15b-4cad-89a3-40ecc0481e27_del complete
Apr 13 19:23:57 user nova-compute[71692]: INFO nova.compute.manager [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 13 19:23:57 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:23:57 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:23:58 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Took 0.52 seconds to deallocate network for instance.
Apr 13 19:23:58 user nova-compute[71692]: DEBUG nova.compute.manager [req-f3ab85bb-58c5-43e2-b6e3-7ae2f2d44e08 req-ebeda3f8-554c-49ea-b4cb-8cb1009adcc9 service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Received event network-vif-deleted-8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:23:58 user nova-compute[71692]: DEBUG nova.compute.manager [req-121e31ec-79e9-4217-b8f2-2d7cbf47b7d8 req-51682eb1-233a-4250-bae5-43f4c327548e service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Received event network-vif-plugged-8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:23:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-121e31ec-79e9-4217-b8f2-2d7cbf47b7d8 req-51682eb1-233a-4250-bae5-43f4c327548e service nova] Acquiring lock "27bf1375-d15b-4cad-89a3-40ecc0481e27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:23:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-121e31ec-79e9-4217-b8f2-2d7cbf47b7d8 req-51682eb1-233a-4250-bae5-43f4c327548e service nova] Lock "27bf1375-d15b-4cad-89a3-40ecc0481e27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:23:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-121e31ec-79e9-4217-b8f2-2d7cbf47b7d8 req-51682eb1-233a-4250-bae5-43f4c327548e service nova] Lock "27bf1375-d15b-4cad-89a3-40ecc0481e27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:23:58 user nova-compute[71692]: DEBUG nova.compute.manager [req-121e31ec-79e9-4217-b8f2-2d7cbf47b7d8 req-51682eb1-233a-4250-bae5-43f4c327548e service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] No waiting events found dispatching network-vif-plugged-8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:23:58 user nova-compute[71692]: WARNING nova.compute.manager [req-121e31ec-79e9-4217-b8f2-2d7cbf47b7d8 req-51682eb1-233a-4250-bae5-43f4c327548e service nova] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Received unexpected event network-vif-plugged-8ee7fe81-e1dc-41a0-96c4-9bb6b34a5c6b for instance with vm_state active and task_state deleting.
Apr 13 19:23:59 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:23:59 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:23:59 user nova-compute[71692]: WARNING nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
Apr 13 19:23:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid ca38627f-4cf1-4331-b447-7e32134e3286 {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:23:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:23:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid 27bf1375-d15b-4cad-89a3-40ecc0481e27 {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:23:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "ca38627f-4cf1-4331-b447-7e32134e3286" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:23:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "ca38627f-4cf1-4331-b447-7e32134e3286" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:23:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:23:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:23:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "27bf1375-d15b-4cad-89a3-40ecc0481e27" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:23:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "ca38627f-4cf1-4331-b447-7e32134e3286" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:23:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:23:59 user nova-compute[71692]: INFO nova.compute.manager [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Took 1.91 seconds to detach 1 volumes for instance.
Apr 13 19:23:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Deleting volume: 960d18d0-fc43-4852-895c-e4c4920c379b {{(pid=71692) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 19:24:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:24:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:24:00 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:24:00 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:24:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:24:00 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Deleted allocations for instance 27bf1375-d15b-4cad-89a3-40ecc0481e27
Apr 13 19:24:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b2bee4fd-421f-4ba6-82bf-64430b011be5 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "27bf1375-d15b-4cad-89a3-40ecc0481e27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.359s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:24:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "27bf1375-d15b-4cad-89a3-40ecc0481e27" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.109s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:24:00 user nova-compute[71692]: INFO nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] During sync_power_state the instance has a pending task (deleting). Skip.
Apr 13 19:24:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "27bf1375-d15b-4cad-89a3-40ecc0481e27" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:24:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "ca38627f-4cf1-4331-b447-7e32134e3286" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:24:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ca38627f-4cf1-4331-b447-7e32134e3286" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:24:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "ca38627f-4cf1-4331-b447-7e32134e3286-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:24:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ca38627f-4cf1-4331-b447-7e32134e3286-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:24:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ca38627f-4cf1-4331-b447-7e32134e3286-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:24:03 user nova-compute[71692]: INFO nova.compute.manager [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Terminating instance
Apr 13 19:24:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:24:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:03 user nova-compute[71692]: DEBUG nova.compute.manager [req-06d2d158-573f-44ba-942a-9532ccbcc7e3 req-e6a850e2-be06-46a1-b89d-950fe849e9d6 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Received event network-vif-unplugged-f9b73165-75e2-47ed-a836-d0704aa5788d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:24:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-06d2d158-573f-44ba-942a-9532ccbcc7e3 req-e6a850e2-be06-46a1-b89d-950fe849e9d6 service nova] Acquiring lock "ca38627f-4cf1-4331-b447-7e32134e3286-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:24:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-06d2d158-573f-44ba-942a-9532ccbcc7e3 req-e6a850e2-be06-46a1-b89d-950fe849e9d6 service nova] Lock "ca38627f-4cf1-4331-b447-7e32134e3286-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:24:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-06d2d158-573f-44ba-942a-9532ccbcc7e3 req-e6a850e2-be06-46a1-b89d-950fe849e9d6 service nova] Lock "ca38627f-4cf1-4331-b447-7e32134e3286-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:24:03 user nova-compute[71692]: DEBUG nova.compute.manager [req-06d2d158-573f-44ba-942a-9532ccbcc7e3 req-e6a850e2-be06-46a1-b89d-950fe849e9d6 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] No waiting events found dispatching network-vif-unplugged-f9b73165-75e2-47ed-a836-d0704aa5788d {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:24:03 user nova-compute[71692]: DEBUG nova.compute.manager [req-06d2d158-573f-44ba-942a-9532ccbcc7e3 req-e6a850e2-be06-46a1-b89d-950fe849e9d6 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Received event network-vif-unplugged-f9b73165-75e2-47ed-a836-d0704aa5788d for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:24:04 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Instance destroyed successfully.
Apr 13 19:24:04 user nova-compute[71692]: DEBUG nova.objects.instance [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lazy-loading 'resources' on Instance uuid ca38627f-4cf1-4331-b447-7e32134e3286 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:24:04 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-592910104',display_name='tempest-AttachVolumeNegativeTest-server-592910104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-592910104',id=34,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyAbm8EUX7I3WFkjXDhcrtssdTYxRcV2GP2/3HprEw0XnjvcQ1CZy+BxvGIuVIAWsa+Rr1WjExbjtk5cqwB2WF85y7qrU1xPaGFgdUsE25Bird1Sw4XYS1a3UKKtgXDRQ==',key_name='tempest-keypair-1088218711',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:21:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0dcc458426af4ea2b4bbcfdf9b4fe041',ramdisk_id='',reservation_id='r-swdz0sq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-513091417',owner_user_name='tempest-AttachVolumeNegativeTest-513091417-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:21:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975d5fe9f1e445f0ba1be8fc71e93ecc',uuid=ca38627f-4cf1-4331-b447-7e32134e3286,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9b73165-75e2-47ed-a836-d0704aa5788d", "address": "fa:16:3e:0b:98:c2", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b73165-75", "ovs_interfaceid": "f9b73165-75e2-47ed-a836-d0704aa5788d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:24:04 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converting VIF {"id": "f9b73165-75e2-47ed-a836-d0704aa5788d", "address": "fa:16:3e:0b:98:c2", "network": {"id": "c6740647-dbe4-4a73-ada4-b154eca2af81", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1088099889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0dcc458426af4ea2b4bbcfdf9b4fe041", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9b73165-75", "ovs_interfaceid": "f9b73165-75e2-47ed-a836-d0704aa5788d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:24:04 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:98:c2,bridge_name='br-int',has_traffic_filtering=True,id=f9b73165-75e2-47ed-a836-d0704aa5788d,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b73165-75') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:24:04 user nova-compute[71692]: DEBUG os_vif [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:98:c2,bridge_name='br-int',has_traffic_filtering=True,id=f9b73165-75e2-47ed-a836-d0704aa5788d,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b73165-75') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:24:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9b73165-75, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:24:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:24:04 user nova-compute[71692]: INFO os_vif [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:98:c2,bridge_name='br-int',has_traffic_filtering=True,id=f9b73165-75e2-47ed-a836-d0704aa5788d,network=Network(c6740647-dbe4-4a73-ada4-b154eca2af81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9b73165-75')
Apr 13 19:24:04 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Deleting instance files /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286_del
Apr 13 19:24:04 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Deletion of /opt/stack/data/nova/instances/ca38627f-4cf1-4331-b447-7e32134e3286_del complete
Apr 13 19:24:04 user nova-compute[71692]: INFO nova.compute.manager [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Took 0.83 seconds to destroy the instance on the hypervisor.
Apr 13 19:24:04 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:24:04 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:24:04 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:24:04 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:24:04 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Took 0.68 seconds to deallocate network for instance.
Apr 13 19:24:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:24:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:24:05 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:24:05 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:24:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:24:05 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Deleted allocations for instance ca38627f-4cf1-4331-b447-7e32134e3286
Apr 13 19:24:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fefbab-1237-4d93-bd34-9f47c6181fcb tempest-AttachVolumeNegativeTest-513091417 tempest-AttachVolumeNegativeTest-513091417-project-member] Lock "ca38627f-4cf1-4331-b447-7e32134e3286" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.859s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:24:05 user nova-compute[71692]: DEBUG nova.compute.manager [req-b0f41d50-cded-4525-bba5-ea45367af67b req-d6271cee-7a3c-4ab4-b6b1-56ddebddd5b5 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Received event network-vif-plugged-f9b73165-75e2-47ed-a836-d0704aa5788d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:24:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b0f41d50-cded-4525-bba5-ea45367af67b req-d6271cee-7a3c-4ab4-b6b1-56ddebddd5b5 service nova] Acquiring lock "ca38627f-4cf1-4331-b447-7e32134e3286-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:24:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b0f41d50-cded-4525-bba5-ea45367af67b req-d6271cee-7a3c-4ab4-b6b1-56ddebddd5b5 service nova] Lock "ca38627f-4cf1-4331-b447-7e32134e3286-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:24:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b0f41d50-cded-4525-bba5-ea45367af67b req-d6271cee-7a3c-4ab4-b6b1-56ddebddd5b5 service nova] Lock "ca38627f-4cf1-4331-b447-7e32134e3286-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:24:05 user nova-compute[71692]: DEBUG nova.compute.manager [req-b0f41d50-cded-4525-bba5-ea45367af67b req-d6271cee-7a3c-4ab4-b6b1-56ddebddd5b5 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] No waiting events found dispatching network-vif-plugged-f9b73165-75e2-47ed-a836-d0704aa5788d {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:24:05 user nova-compute[71692]: WARNING nova.compute.manager [req-b0f41d50-cded-4525-bba5-ea45367af67b req-d6271cee-7a3c-4ab4-b6b1-56ddebddd5b5 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Received unexpected event network-vif-plugged-f9b73165-75e2-47ed-a836-d0704aa5788d for instance with vm_state deleted and task_state None.
Apr 13 19:24:05 user nova-compute[71692]: DEBUG nova.compute.manager [req-b0f41d50-cded-4525-bba5-ea45367af67b req-d6271cee-7a3c-4ab4-b6b1-56ddebddd5b5 service nova] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Received event network-vif-deleted-f9b73165-75e2-47ed-a836-d0704aa5788d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:24:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:12 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413837.0625625, 27bf1375-d15b-4cad-89a3-40ecc0481e27 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:24:12 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] VM Stopped (Lifecycle Event)
Apr 13 19:24:12 user nova-compute[71692]: DEBUG nova.compute.manager [None req-98dd5bad-3b98-4908-9653-a55ebbe584d0 None None] [instance: 27bf1375-d15b-4cad-89a3-40ecc0481e27] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:24:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:19 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681413844.2064607, ca38627f-4cf1-4331-b447-7e32134e3286 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:24:19 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] VM Stopped (Lifecycle Event)
Apr 13 19:24:19 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ad80a5ed-d42a-4a87-8a23-83f1396740cd None None] [instance: ca38627f-4cf1-4331-b447-7e32134e3286] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:24:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:24:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:24:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:24:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:24:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:24:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:24:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:24:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:24:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:24:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:24:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:24:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:24:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:24:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:24:37 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:24:37 user nova-compute[71692]: INFO nova.compute.claims [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Claim successful on node user
Apr 13 19:24:37 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:24:37 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:24:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:24:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:24:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:24:37 user nova-compute[71692]: DEBUG nova.network.neutron [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:24:37 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:24:37 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:24:37 user nova-compute[71692]: INFO nova.virt.block_device [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Booting with blank volume at /dev/vda
Apr 13 19:24:37 user nova-compute[71692]: DEBUG nova.policy [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:24:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:38 user nova-compute[71692]: DEBUG nova.network.neutron [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Successfully created port: 405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:24:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:39 user nova-compute[71692]: DEBUG nova.network.neutron [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Successfully updated port: 405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:24:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:24:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquired lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:24:39 user nova-compute[71692]: DEBUG nova.network.neutron [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:24:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-67cb8a94-9bca-4370-b489-a9f03f86d974 req-9a29fd27-e8a1-4231-b794-3a0eced35110 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received event network-changed-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:24:39 user nova-compute[71692]: DEBUG nova.compute.manager [req-67cb8a94-9bca-4370-b489-a9f03f86d974 req-9a29fd27-e8a1-4231-b794-3a0eced35110 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Refreshing instance network info cache due to event network-changed-405a3575-62ce-4c5c-8090-40f2fabf7d61. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:24:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-67cb8a94-9bca-4370-b489-a9f03f86d974 req-9a29fd27-e8a1-4231-b794-3a0eced35110 service nova] Acquiring lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:24:39 user nova-compute[71692]: DEBUG nova.network.neutron [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:24:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Updating instance_info_cache with network_info: [{"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:24:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Releasing lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:24:40 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Instance network_info: |[{"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:24:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-67cb8a94-9bca-4370-b489-a9f03f86d974 req-9a29fd27-e8a1-4231-b794-3a0eced35110 service nova] Acquired lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:24:40 user nova-compute[71692]: DEBUG nova.network.neutron [req-67cb8a94-9bca-4370-b489-a9f03f86d974 req-9a29fd27-e8a1-4231-b794-3a0eced35110 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Refreshing network info cache for port 405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:24:40 user nova-compute[71692]: DEBUG nova.network.neutron [req-67cb8a94-9bca-4370-b489-a9f03f86d974 req-9a29fd27-e8a1-4231-b794-3a0eced35110 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Updated VIF entry in instance network info cache for port 405a3575-62ce-4c5c-8090-40f2fabf7d61. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:24:40 user nova-compute[71692]: DEBUG nova.network.neutron [req-67cb8a94-9bca-4370-b489-a9f03f86d974 req-9a29fd27-e8a1-4231-b794-3a0eced35110 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Updating instance_info_cache with network_info: [{"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:24:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-67cb8a94-9bca-4370-b489-a9f03f86d974 req-9a29fd27-e8a1-4231-b794-3a0eced35110 service nova] Releasing lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG os_brick.utils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af5f97e-4165-4f4e-bd61-2da8136b0c11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8720a6-d542-4ead-95eb-7720be122f24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[616deb88-b27e-4633-b31f-7de8fec249dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39b89e5-1a1c-4625-a131-183387422549]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:24:43 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:24:43 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0836f5f0-a60a-49f3-9d85-d2f6e70f53c0]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG os_brick.utils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:24:43 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Updating existing volume attachment record: 94c2b289-8cdb-494d-8137-0f58ae654ed2 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:24:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:24:47 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Creating image(s)
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Did not create local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Ensure instance console log exists: /opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Start _get_guest_xml network_info=[{"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '94c2b289-8cdb-494d-8137-0f58ae654ed2', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLywANqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '991871a0-3a4e-4014-b07f-3e8c49eeda5a', 'attached_at': '', 'detached_at': '', 'volume_id': '313c34d8-f051-4710-8baf-f34af4471945', 'serial': '313c34d8-f051-4710-8baf-f34af4471945'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:24:47 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:24:47 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLywANqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:24:47 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:24:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:24:47 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:24:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:24:47 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:24:47 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:24:47 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[685a454e-be10-467a-9a24-edc978959bcb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:24:48 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c19dad-7e51-43ba-ab92-a936dbeb01ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945] added
Apr 13 19:24:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9042d5d1-f33d-4e3e-b22f-5a4f7711080b]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4069dbaf-fa58-4d89-bb88-fe6f301cb4fb]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PLywANqO {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PLywANqO" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46ec739-a80f-44ea-9cf3-27a6b56c9020]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PLywANqO'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e21b71-0c19-41aa-9101-5722747ef839]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41590b1-54fd-4168-baa8-20dee4b6fdcf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 19:24:48 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 19:24:48 user nova-compute[71692]:  {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:24:48 user nova-compute[71692]: WARNING os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 19:24:48 user nova-compute[71692]: 
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[752ba99e-7106-443e-9b67-e4a6c880c02e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945, portal: 172.16.0.220,3260]
Apr 13 19:24:48 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945, portal: 172.16.0.220,3260] successful.
Apr 13 19:24:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6703a63b-c887-4a60-a7e1-1bb3854d1b61]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb2b805-b071-4ca5-97f8-3a12cb20ff9a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:24:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:24:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[60225f4c-f186-445a-9188-f3702f85f3a6]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:48 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLywANqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26562386465356365', 'path': '/dev/sdb'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562386465356365', 'path': '/dev/sdb'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-984612808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-984612808',id=37,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c00a7fcd6d3040e8b2db0448eeda93ad',ramdisk_id='',reservation_id='r-tflw5ozm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:24:38Z,user_data=None,user_id='dd604fa4d17b42b1abea8c2f2405b58d',uuid=991871a0-3a4e-4014-b07f-3e8c49eeda5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converting VIF {"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:17:3b,bridge_name='br-int',has_traffic_filtering=True,id=405a3575-62ce-4c5c-8090-40f2fabf7d61,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405a3575-62') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG nova.objects.instance [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'pci_devices' on Instance uuid 991871a0-3a4e-4014-b07f-3e8c49eeda5a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:24:49 user nova-compute[71692]:   <uuid>991871a0-3a4e-4014-b07f-3e8c49eeda5a</uuid>
Apr 13 19:24:49 user nova-compute[71692]:   <name>instance-00000025</name>
Apr 13 19:24:49 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:24:49 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:24:49 user nova-compute[71692]:   <metadata>
Apr 13 19:24:49 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:24:49 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:24:49 user nova-compute[71692]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-984612808</nova:name>
Apr 13 19:24:49 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:24:47</nova:creationTime>
Apr 13 19:24:49 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:24:49 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:24:49 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:24:49 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:24:49 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:24:49 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:24:49 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:24:49 user nova-compute[71692]:       <nova:owner>
Apr 13 19:24:49 user nova-compute[71692]:         <nova:user uuid="dd604fa4d17b42b1abea8c2f2405b58d">tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member</nova:user>
Apr 13 19:24:49 user nova-compute[71692]:         <nova:project uuid="c00a7fcd6d3040e8b2db0448eeda93ad">tempest-ServerBootFromVolumeStableRescueTest-1051313256</nova:project>
Apr 13 19:24:49 user nova-compute[71692]:       </nova:owner>
Apr 13 19:24:49 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:24:49 user nova-compute[71692]:       <nova:ports>
Apr 13 19:24:49 user nova-compute[71692]:         <nova:port uuid="405a3575-62ce-4c5c-8090-40f2fabf7d61">
Apr 13 19:24:49 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 19:24:49 user nova-compute[71692]:         </nova:port>
Apr 13 19:24:49 user nova-compute[71692]:       </nova:ports>
Apr 13 19:24:49 user nova-compute[71692]:     </nova:instance>
Apr 13 19:24:49 user nova-compute[71692]:   </metadata>
Apr 13 19:24:49 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:24:49 user nova-compute[71692]:     <system>
Apr 13 19:24:49 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:24:49 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:24:49 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:24:49 user nova-compute[71692]:       <entry name="serial">991871a0-3a4e-4014-b07f-3e8c49eeda5a</entry>
Apr 13 19:24:49 user nova-compute[71692]:       <entry name="uuid">991871a0-3a4e-4014-b07f-3e8c49eeda5a</entry>
Apr 13 19:24:49 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:24:49 user nova-compute[71692]:     </system>
Apr 13 19:24:49 user nova-compute[71692]:   </sysinfo>
Apr 13 19:24:49 user nova-compute[71692]:   <os>
Apr 13 19:24:49 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:24:49 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:24:49 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:24:49 user nova-compute[71692]:   </os>
Apr 13 19:24:49 user nova-compute[71692]:   <features>
Apr 13 19:24:49 user nova-compute[71692]:     <acpi/>
Apr 13 19:24:49 user nova-compute[71692]:     <apic/>
Apr 13 19:24:49 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:24:49 user nova-compute[71692]:   </features>
Apr 13 19:24:49 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:24:49 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:24:49 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:24:49 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:24:49 user nova-compute[71692]:   </clock>
Apr 13 19:24:49 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:24:49 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:24:49 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:24:49 user nova-compute[71692]:   </cpu>
Apr 13 19:24:49 user nova-compute[71692]:   <devices>
Apr 13 19:24:49 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:24:49 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:24:49 user nova-compute[71692]:       <source dev="/dev/sdb"/>
Apr 13 19:24:49 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:24:49 user nova-compute[71692]:       <serial>313c34d8-f051-4710-8baf-f34af4471945</serial>
Apr 13 19:24:49 user nova-compute[71692]:     </disk>
Apr 13 19:24:49 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:24:49 user nova-compute[71692]:       <mac address="fa:16:3e:c8:17:3b"/>
Apr 13 19:24:49 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:24:49 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:24:49 user nova-compute[71692]:       <target dev="tap405a3575-62"/>
Apr 13 19:24:49 user nova-compute[71692]:     </interface>
Apr 13 19:24:49 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:24:49 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a/console.log" append="off"/>
Apr 13 19:24:49 user nova-compute[71692]:     </serial>
Apr 13 19:24:49 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:24:49 user nova-compute[71692]:     <video>
Apr 13 19:24:49 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:24:49 user nova-compute[71692]:     </video>
Apr 13 19:24:49 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:24:49 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:24:49 user nova-compute[71692]:     </rng>
Apr 13 19:24:49 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:24:49 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:24:49 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:24:49 user nova-compute[71692]:     </memballoon>
Apr 13 19:24:49 user nova-compute[71692]:   </devices>
Apr 13 19:24:49 user nova-compute[71692]: </domain>
Apr 13 19:24:49 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-984612808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-984612808',id=37,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c00a7fcd6d3040e8b2db0448eeda93ad',ramdisk_id='',reservation_id='r-tflw5ozm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:24:38Z,user_data=None,user_id='dd604fa4d17b42b1abea8c2f2405b58d',uuid=991871a0-3a4e-4014-b07f-3e8c49eeda5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converting VIF {"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:17:3b,bridge_name='br-int',has_traffic_filtering=True,id=405a3575-62ce-4c5c-8090-40f2fabf7d61,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405a3575-62') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG os_vif [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:17:3b,bridge_name='br-int',has_traffic_filtering=True,id=405a3575-62ce-4c5c-8090-40f2fabf7d61,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405a3575-62') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap405a3575-62, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap405a3575-62, col_values=(('external_ids', {'iface-id': '405a3575-62ce-4c5c-8090-40f2fabf7d61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:17:3b', 'vm-uuid': '991871a0-3a4e-4014-b07f-3e8c49eeda5a'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:49 user nova-compute[71692]: INFO os_vif [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:17:3b,bridge_name='br-int',has_traffic_filtering=True,id=405a3575-62ce-4c5c-8090-40f2fabf7d61,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405a3575-62')
Apr 13 19:24:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:24:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] No VIF found with MAC fa:16:3e:c8:17:3b, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:24:50 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:24:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:50 user nova-compute[71692]: DEBUG nova.compute.manager [req-08327eea-3966-4033-8b1e-d79493bf7107 req-46e5215f-af6d-4e47-a255-b93ad15f2216 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:24:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-08327eea-3966-4033-8b1e-d79493bf7107 req-46e5215f-af6d-4e47-a255-b93ad15f2216 service nova] Acquiring lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:24:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-08327eea-3966-4033-8b1e-d79493bf7107 req-46e5215f-af6d-4e47-a255-b93ad15f2216 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:24:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-08327eea-3966-4033-8b1e-d79493bf7107 req-46e5215f-af6d-4e47-a255-b93ad15f2216 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:24:50 user nova-compute[71692]: DEBUG nova.compute.manager [req-08327eea-3966-4033-8b1e-d79493bf7107 req-46e5215f-af6d-4e47-a255-b93ad15f2216 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] No waiting events found dispatching network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:24:50 user nova-compute[71692]: WARNING nova.compute.manager [req-08327eea-3966-4033-8b1e-d79493bf7107 req-46e5215f-af6d-4e47-a255-b93ad15f2216 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received unexpected event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance with vm_state building and task_state spawning.
Apr 13 19:24:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:51 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:24:51 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:24:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:24:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 19:24:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Skipping network cache update for instance because it is Building. {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 13 19:24:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:24:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:24:51 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:24:51 user nova-compute[71692]: DEBUG nova.objects.instance [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lazy-loading 'info_cache' on Instance uuid 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:24:51 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updating instance_info_cache with network_info: [{"id": "5bd81344-f669-49c6-897f-97510d86e77b", "address": "fa:16:3e:01:0c:f9", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd81344-f6", "ovs_interfaceid": "5bd81344-f669-49c6-897f-97510d86e77b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:24:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:24:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:24:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:52 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413892.9162817, 991871a0-3a4e-4014-b07f-3e8c49eeda5a => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:24:52 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] VM Resumed (Lifecycle Event)
Apr 13 19:24:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:24:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:24:52 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Instance spawned successfully.
Apr 13 19:24:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:24:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:24:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:24:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:24:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:24:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:24:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:24:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:24:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:24:52 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:24:53 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413892.918619, 991871a0-3a4e-4014-b07f-3e8c49eeda5a => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:24:53 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] VM Started (Lifecycle Event)
Apr 13 19:24:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-9a05061b-930a-45d2-bd25-e3312277df7b req-4c3a0ee4-99cc-46b3-a773-8d5dd4ea1607 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:24:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9a05061b-930a-45d2-bd25-e3312277df7b req-4c3a0ee4-99cc-46b3-a773-8d5dd4ea1607 service nova] Acquiring lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:24:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9a05061b-930a-45d2-bd25-e3312277df7b req-4c3a0ee4-99cc-46b3-a773-8d5dd4ea1607 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:24:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9a05061b-930a-45d2-bd25-e3312277df7b req-4c3a0ee4-99cc-46b3-a773-8d5dd4ea1607 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:24:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-9a05061b-930a-45d2-bd25-e3312277df7b req-4c3a0ee4-99cc-46b3-a773-8d5dd4ea1607 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] No waiting events found dispatching network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:24:53 user nova-compute[71692]: WARNING nova.compute.manager [req-9a05061b-930a-45d2-bd25-e3312277df7b req-4c3a0ee4-99cc-46b3-a773-8d5dd4ea1607 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received unexpected event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance with vm_state building and task_state spawning.
Apr 13 19:24:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:24:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:24:53 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:24:53 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:24:53 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:24:53 user nova-compute[71692]: INFO nova.compute.manager [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Took 5.23 seconds to spawn the instance on the hypervisor.
Apr 13 19:24:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:24:53 user nova-compute[71692]: INFO nova.compute.manager [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Took 15.74 seconds to build instance.
Apr 13 19:24:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-2cf48502-e377-4ae0-a07b-89c07cad54ba tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.829s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:24:54 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:24:54 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:24:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:24:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:24:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:24:54 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:24:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:24:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:54 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:24:54 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:24:54 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:24:54 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8681MB free_disk=26.094650268554688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:24:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:24:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:24:55 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:24:55 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:24:55 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:24:55 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:24:55 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:24:55 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:24:55 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:24:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:24:56 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:24:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:24:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:24:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:24:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:24:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:24:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:24:56 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:24:56 user nova-compute[71692]: INFO nova.compute.claims [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Claim successful on node user
Apr 13 19:24:56 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:24:56 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:24:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:24:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:24:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:24:56 user nova-compute[71692]: DEBUG nova.network.neutron [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:24:56 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:24:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG nova.policy [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:24:57 user nova-compute[71692]: INFO nova.virt.block_device [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Booting with volume 6002893f-ec8f-478d-89e7-2761f21a1ed5 at /dev/vda
Apr 13 19:24:57 user nova-compute[71692]: DEBUG os_brick.utils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bf2ffd-57ed-4ff2-a0ac-7c95a9709c8b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4d8b11-4240-435f-b5c6-22502307fd18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb16d74-7b97-4e1f-9c1a-f243546d5887]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea38f652-e0f9-442b-89d9-f9ede9e7c6d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:24:57 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:24:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2b5085-7397-4b03-b882-97cda054bca9]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG os_brick.utils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Updating existing volume attachment record: b51af9c7-af2a-40b8-acee-71ca0a996861 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:24:57 user nova-compute[71692]: DEBUG nova.network.neutron [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Successfully created port: d4720014-5ce3-41b2-80e7-02fc430417f3 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:24:58 user nova-compute[71692]: DEBUG nova.network.neutron [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Successfully updated port: d4720014-5ce3-41b2-80e7-02fc430417f3 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:24:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "refresh_cache-4f05f7e3-6b1d-42bb-a567-ebfab8001772" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:24:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquired lock "refresh_cache-4f05f7e3-6b1d-42bb-a567-ebfab8001772" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:24:58 user nova-compute[71692]: DEBUG nova.network.neutron [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:24:58 user nova-compute[71692]: DEBUG nova.compute.manager [req-b2c71503-3ec8-4631-8e31-e6250e71f04b req-b94784ea-aa1c-4d3d-a7f0-da90452a2fb9 service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Received event network-changed-d4720014-5ce3-41b2-80e7-02fc430417f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:24:58 user nova-compute[71692]: DEBUG nova.compute.manager [req-b2c71503-3ec8-4631-8e31-e6250e71f04b req-b94784ea-aa1c-4d3d-a7f0-da90452a2fb9 service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Refreshing instance network info cache due to event network-changed-d4720014-5ce3-41b2-80e7-02fc430417f3. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:24:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b2c71503-3ec8-4631-8e31-e6250e71f04b req-b94784ea-aa1c-4d3d-a7f0-da90452a2fb9 service nova] Acquiring lock "refresh_cache-4f05f7e3-6b1d-42bb-a567-ebfab8001772" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:24:58 user nova-compute[71692]: DEBUG nova.network.neutron [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:24:58 user nova-compute[71692]: DEBUG nova.network.neutron [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Updating instance_info_cache with network_info: [{"id": "d4720014-5ce3-41b2-80e7-02fc430417f3", "address": "fa:16:3e:f0:2e:55", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4720014-5c", "ovs_interfaceid": "d4720014-5ce3-41b2-80e7-02fc430417f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:24:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Releasing lock "refresh_cache-4f05f7e3-6b1d-42bb-a567-ebfab8001772" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:24:58 user nova-compute[71692]: DEBUG nova.compute.manager [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Instance network_info: |[{"id": "d4720014-5ce3-41b2-80e7-02fc430417f3", "address": "fa:16:3e:f0:2e:55", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4720014-5c", "ovs_interfaceid": "d4720014-5ce3-41b2-80e7-02fc430417f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:24:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b2c71503-3ec8-4631-8e31-e6250e71f04b req-b94784ea-aa1c-4d3d-a7f0-da90452a2fb9 service nova] Acquired lock "refresh_cache-4f05f7e3-6b1d-42bb-a567-ebfab8001772" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:24:58 user nova-compute[71692]: DEBUG nova.network.neutron [req-b2c71503-3ec8-4631-8e31-e6250e71f04b req-b94784ea-aa1c-4d3d-a7f0-da90452a2fb9 service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Refreshing network info cache for port d4720014-5ce3-41b2-80e7-02fc430417f3 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:24:59 user nova-compute[71692]: DEBUG nova.network.neutron [req-b2c71503-3ec8-4631-8e31-e6250e71f04b req-b94784ea-aa1c-4d3d-a7f0-da90452a2fb9 service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Updated VIF entry in instance network info cache for port d4720014-5ce3-41b2-80e7-02fc430417f3. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:24:59 user nova-compute[71692]: DEBUG nova.network.neutron [req-b2c71503-3ec8-4631-8e31-e6250e71f04b req-b94784ea-aa1c-4d3d-a7f0-da90452a2fb9 service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Updating instance_info_cache with network_info: [{"id": "d4720014-5ce3-41b2-80e7-02fc430417f3", "address": "fa:16:3e:f0:2e:55", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4720014-5c", "ovs_interfaceid": "d4720014-5ce3-41b2-80e7-02fc430417f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:24:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b2c71503-3ec8-4631-8e31-e6250e71f04b req-b94784ea-aa1c-4d3d-a7f0-da90452a2fb9 service nova] Releasing lock "refresh_cache-4f05f7e3-6b1d-42bb-a567-ebfab8001772" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:24:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:25:00 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:25:01 user nova-compute[71692]: DEBUG nova.compute.manager [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:25:01 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:25:01 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Creating image(s)
Apr 13 19:25:01 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Did not create local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 19:25:01 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Ensure instance console log exists: /opt/stack/data/nova/instances/4f05f7e3-6b1d-42bb-a567-ebfab8001772/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:25:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:25:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:25:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:25:01 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Start _get_guest_xml network_info=[{"id": "d4720014-5ce3-41b2-80e7-02fc430417f3", "address": "fa:16:3e:f0:2e:55", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4720014-5c", "ovs_interfaceid": "d4720014-5ce3-41b2-80e7-02fc430417f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'b51af9c7-af2a-40b8-acee-71ca0a996861', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQVmxwZR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f05f7e3-6b1d-42bb-a567-ebfab8001772', 'attached_at': '', 'detached_at': '', 'volume_id': '6002893f-ec8f-478d-89e7-2761f21a1ed5', 'serial': '6002893f-ec8f-478d-89e7-2761f21a1ed5'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:25:02 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:25:02 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:25:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQVmxwZR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:25:02 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:25:02 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:25:02 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f931e7b-af2f-46a4-884a-4f5001a100e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:25:02 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b27be1-efc1-4192-a2a9-50e7bd9759ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5] added
Apr 13 19:25:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cef6ec-7e69-4c66-94b7-cac030c9db6f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cf1c5e-0b15-44fd-ae8c-9bac20849231]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQVmxwZR {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kQVmxwZR" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccfd8dd-810f-46f6-b1e2-01d7ff426936]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kQVmxwZR'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[958a401d-9a91-4352-98fc-47c02540b0a3]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2852cc54-4c2a-4a35-9628-213d2e4b0c4d]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:25:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:25:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[20717593-188d-47d6-aa4f-8461d9e73e5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5, portal: 172.16.0.220,3260]
Apr 13 19:25:02 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5, portal: 172.16.0.220,3260] successful.
Apr 13 19:25:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[362efc3c-77bf-4325-91ba-a90442a27ec9]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bb2a74-7a9b-41e0-a76b-6991a4eeef81]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:25:02 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:25:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:25:02 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:25:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6c1712-23d9-4915-b381-2dc2b6de3f9b]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:25:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQVmxwZR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23964643839336534', 'path': '/dev/sdc'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964643839336534', 'path': '/dev/sdc'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:24:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-241646845',display_name='tempest-TestVolumeBootPattern-volume-backed-server-241646845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-241646845',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-elgmxrk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:24:57Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=4f05f7e3-6b1d-42bb-a567-ebfab8001772,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4720014-5ce3-41b2-80e7-02fc430417f3", "address": "fa:16:3e:f0:2e:55", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4720014-5c", "ovs_interfaceid": "d4720014-5ce3-41b2-80e7-02fc430417f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "d4720014-5ce3-41b2-80e7-02fc430417f3", "address": "fa:16:3e:f0:2e:55", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4720014-5c", "ovs_interfaceid": "d4720014-5ce3-41b2-80e7-02fc430417f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2e:55,bridge_name='br-int',has_traffic_filtering=True,id=d4720014-5ce3-41b2-80e7-02fc430417f3,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4720014-5c') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG nova.objects.instance [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f05f7e3-6b1d-42bb-a567-ebfab8001772 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:25:03 user nova-compute[71692]:   <uuid>4f05f7e3-6b1d-42bb-a567-ebfab8001772</uuid>
Apr 13 19:25:03 user nova-compute[71692]:   <name>instance-00000026</name>
Apr 13 19:25:03 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:25:03 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:25:03 user nova-compute[71692]:   <metadata>
Apr 13 19:25:03 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:25:03 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:25:03 user nova-compute[71692]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-241646845</nova:name>
Apr 13 19:25:03 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:25:02</nova:creationTime>
Apr 13 19:25:03 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:25:03 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:25:03 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:25:03 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:25:03 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:25:03 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:25:03 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:25:03 user nova-compute[71692]:       <nova:owner>
Apr 13 19:25:03 user nova-compute[71692]:         <nova:user uuid="526d9c809b81418d89da662f973a1bdc">tempest-TestVolumeBootPattern-1717000141-project-member</nova:user>
Apr 13 19:25:03 user nova-compute[71692]:         <nova:project uuid="a5231d999e51417ebe91927707bfd2bd">tempest-TestVolumeBootPattern-1717000141</nova:project>
Apr 13 19:25:03 user nova-compute[71692]:       </nova:owner>
Apr 13 19:25:03 user nova-compute[71692]:       <nova:ports>
Apr 13 19:25:03 user nova-compute[71692]:         <nova:port uuid="d4720014-5ce3-41b2-80e7-02fc430417f3">
Apr 13 19:25:03 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 19:25:03 user nova-compute[71692]:         </nova:port>
Apr 13 19:25:03 user nova-compute[71692]:       </nova:ports>
Apr 13 19:25:03 user nova-compute[71692]:     </nova:instance>
Apr 13 19:25:03 user nova-compute[71692]:   </metadata>
Apr 13 19:25:03 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:25:03 user nova-compute[71692]:     <system>
Apr 13 19:25:03 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:25:03 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:25:03 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:25:03 user nova-compute[71692]:       <entry name="serial">4f05f7e3-6b1d-42bb-a567-ebfab8001772</entry>
Apr 13 19:25:03 user nova-compute[71692]:       <entry name="uuid">4f05f7e3-6b1d-42bb-a567-ebfab8001772</entry>
Apr 13 19:25:03 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:25:03 user nova-compute[71692]:     </system>
Apr 13 19:25:03 user nova-compute[71692]:   </sysinfo>
Apr 13 19:25:03 user nova-compute[71692]:   <os>
Apr 13 19:25:03 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:25:03 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:25:03 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:25:03 user nova-compute[71692]:   </os>
Apr 13 19:25:03 user nova-compute[71692]:   <features>
Apr 13 19:25:03 user nova-compute[71692]:     <acpi/>
Apr 13 19:25:03 user nova-compute[71692]:     <apic/>
Apr 13 19:25:03 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:25:03 user nova-compute[71692]:   </features>
Apr 13 19:25:03 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:25:03 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:25:03 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:25:03 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:25:03 user nova-compute[71692]:   </clock>
Apr 13 19:25:03 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:25:03 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:25:03 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:25:03 user nova-compute[71692]:   </cpu>
Apr 13 19:25:03 user nova-compute[71692]:   <devices>
Apr 13 19:25:03 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:25:03 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:25:03 user nova-compute[71692]:       <source dev="/dev/sdc"/>
Apr 13 19:25:03 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:25:03 user nova-compute[71692]:       <serial>6002893f-ec8f-478d-89e7-2761f21a1ed5</serial>
Apr 13 19:25:03 user nova-compute[71692]:     </disk>
Apr 13 19:25:03 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:25:03 user nova-compute[71692]:       <mac address="fa:16:3e:f0:2e:55"/>
Apr 13 19:25:03 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:25:03 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:25:03 user nova-compute[71692]:       <target dev="tapd4720014-5c"/>
Apr 13 19:25:03 user nova-compute[71692]:     </interface>
Apr 13 19:25:03 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:25:03 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/4f05f7e3-6b1d-42bb-a567-ebfab8001772/console.log" append="off"/>
Apr 13 19:25:03 user nova-compute[71692]:     </serial>
Apr 13 19:25:03 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:25:03 user nova-compute[71692]:     <video>
Apr 13 19:25:03 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:25:03 user nova-compute[71692]:     </video>
Apr 13 19:25:03 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:25:03 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:25:03 user nova-compute[71692]:     </rng>
Apr 13 19:25:03 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:25:03 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:25:03 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:25:03 user nova-compute[71692]:     </memballoon>
Apr 13 19:25:03 user nova-compute[71692]:   </devices>
Apr 13 19:25:03 user nova-compute[71692]: </domain>
Apr 13 19:25:03 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:24:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-241646845',display_name='tempest-TestVolumeBootPattern-volume-backed-server-241646845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-241646845',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-elgmxrk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:24:57Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=4f05f7e3-6b1d-42bb-a567-ebfab8001772,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4720014-5ce3-41b2-80e7-02fc430417f3", "address": "fa:16:3e:f0:2e:55", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4720014-5c", "ovs_interfaceid": "d4720014-5ce3-41b2-80e7-02fc430417f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "d4720014-5ce3-41b2-80e7-02fc430417f3", "address": "fa:16:3e:f0:2e:55", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4720014-5c", "ovs_interfaceid": "d4720014-5ce3-41b2-80e7-02fc430417f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2e:55,bridge_name='br-int',has_traffic_filtering=True,id=d4720014-5ce3-41b2-80e7-02fc430417f3,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4720014-5c') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG os_vif [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2e:55,bridge_name='br-int',has_traffic_filtering=True,id=d4720014-5ce3-41b2-80e7-02fc430417f3,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4720014-5c') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4720014-5c, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4720014-5c, col_values=(('external_ids', {'iface-id': 'd4720014-5ce3-41b2-80e7-02fc430417f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:2e:55', 'vm-uuid': '4f05f7e3-6b1d-42bb-a567-ebfab8001772'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:03 user nova-compute[71692]: INFO os_vif [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2e:55,bridge_name='br-int',has_traffic_filtering=True,id=d4720014-5ce3-41b2-80e7-02fc430417f3,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4720014-5c')
Apr 13 19:25:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] No VIF found with MAC fa:16:3e:f0:2e:55, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:25:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:05 user nova-compute[71692]: DEBUG nova.compute.manager [req-1fb9b905-6844-4279-970f-5827444fe06e req-15974671-fe78-4088-8698-1958642c4836 service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Received event network-vif-plugged-d4720014-5ce3-41b2-80e7-02fc430417f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:25:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1fb9b905-6844-4279-970f-5827444fe06e req-15974671-fe78-4088-8698-1958642c4836 service nova] Acquiring lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:25:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1fb9b905-6844-4279-970f-5827444fe06e req-15974671-fe78-4088-8698-1958642c4836 service nova] Lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:25:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1fb9b905-6844-4279-970f-5827444fe06e req-15974671-fe78-4088-8698-1958642c4836 service nova] Lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:25:05 user nova-compute[71692]: DEBUG nova.compute.manager [req-1fb9b905-6844-4279-970f-5827444fe06e req-15974671-fe78-4088-8698-1958642c4836 service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] No waiting events found dispatching network-vif-plugged-d4720014-5ce3-41b2-80e7-02fc430417f3 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:25:05 user nova-compute[71692]: WARNING nova.compute.manager [req-1fb9b905-6844-4279-970f-5827444fe06e req-15974671-fe78-4088-8698-1958642c4836 service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Received unexpected event network-vif-plugged-d4720014-5ce3-41b2-80e7-02fc430417f3 for instance with vm_state building and task_state spawning.
Apr 13 19:25:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:06 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413906.8222513, 4f05f7e3-6b1d-42bb-a567-ebfab8001772 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:25:06 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] VM Resumed (Lifecycle Event)
Apr 13 19:25:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:25:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:25:06 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Instance spawned successfully.
Apr 13 19:25:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:25:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:25:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:25:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:25:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:25:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:25:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:25:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:25:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:25:06 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:25:06 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413906.8256276, 4f05f7e3-6b1d-42bb-a567-ebfab8001772 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:25:06 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] VM Started (Lifecycle Event)
Apr 13 19:25:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:25:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:25:06 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:25:06 user nova-compute[71692]: INFO nova.compute.manager [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Took 4.94 seconds to spawn the instance on the hypervisor.
Apr 13 19:25:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:25:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:07 user nova-compute[71692]: INFO nova.compute.manager [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Took 10.46 seconds to build instance.
Apr 13 19:25:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bb54a216-8691-4986-9505-315356f41127 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.560s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:25:07 user nova-compute[71692]: DEBUG nova.compute.manager [req-95afc92a-b746-4f43-a90d-033ba293eb21 req-274f2cb9-92fe-4ada-8312-1763bd3ac7d7 service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Received event network-vif-plugged-d4720014-5ce3-41b2-80e7-02fc430417f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:25:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-95afc92a-b746-4f43-a90d-033ba293eb21 req-274f2cb9-92fe-4ada-8312-1763bd3ac7d7 service nova] Acquiring lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:25:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-95afc92a-b746-4f43-a90d-033ba293eb21 req-274f2cb9-92fe-4ada-8312-1763bd3ac7d7 service nova] Lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:25:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-95afc92a-b746-4f43-a90d-033ba293eb21 req-274f2cb9-92fe-4ada-8312-1763bd3ac7d7 service nova] Lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:25:07 user nova-compute[71692]: DEBUG nova.compute.manager [req-95afc92a-b746-4f43-a90d-033ba293eb21 req-274f2cb9-92fe-4ada-8312-1763bd3ac7d7 service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] No waiting events found dispatching network-vif-plugged-d4720014-5ce3-41b2-80e7-02fc430417f3 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:25:07 user nova-compute[71692]: WARNING nova.compute.manager [req-95afc92a-b746-4f43-a90d-033ba293eb21 req-274f2cb9-92fe-4ada-8312-1763bd3ac7d7 service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Received unexpected event network-vif-plugged-d4720014-5ce3-41b2-80e7-02fc430417f3 for instance with vm_state active and task_state None.
Apr 13 19:25:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:25:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:25:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:25:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:25:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:25:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:50 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:25:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:52 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:25:53 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:25:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:25:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 19:25:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:25:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:25:53 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:25:53 user nova-compute[71692]: DEBUG nova.objects.instance [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lazy-loading 'info_cache' on Instance uuid 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:25:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:25:53 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updating instance_info_cache with network_info: [{"id": "5bd81344-f669-49c6-897f-97510d86e77b", "address": "fa:16:3e:01:0c:f9", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd81344-f6", "ovs_interfaceid": "5bd81344-f669-49c6-897f-97510d86e77b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:25:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:25:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:25:55 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:25:55 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:25:55 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:25:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:25:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:25:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:25:55 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:25:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:25:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:25:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:25:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:25:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:25:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:25:56 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:25:56 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:25:56 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8628MB free_disk=26.0823974609375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:25:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:25:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:25:56 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:25:56 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:25:56 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:25:56 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:25:56 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:25:56 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:25:56 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:25:56 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:25:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:25:57 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:25:57 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:25:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:25:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:26:02 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:26:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:26:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:26:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:26:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:26:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:26:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:28 user nova-compute[71692]: INFO nova.compute.manager [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Rescuing
Apr 13 19:26:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:26:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquired lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:26:28 user nova-compute[71692]: DEBUG nova.network.neutron [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:26:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:26:28 user nova-compute[71692]: DEBUG nova.network.neutron [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Updating instance_info_cache with network_info: [{"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:26:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Releasing lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:26:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:29 user nova-compute[71692]: DEBUG nova.compute.manager [req-3e721b91-d0d9-4f1b-a455-e307743cfc22 req-4fd315d2-f99f-46d9-9dab-75c8a2620d06 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received event network-vif-unplugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:26:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3e721b91-d0d9-4f1b-a455-e307743cfc22 req-4fd315d2-f99f-46d9-9dab-75c8a2620d06 service nova] Acquiring lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3e721b91-d0d9-4f1b-a455-e307743cfc22 req-4fd315d2-f99f-46d9-9dab-75c8a2620d06 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3e721b91-d0d9-4f1b-a455-e307743cfc22 req-4fd315d2-f99f-46d9-9dab-75c8a2620d06 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:29 user nova-compute[71692]: DEBUG nova.compute.manager [req-3e721b91-d0d9-4f1b-a455-e307743cfc22 req-4fd315d2-f99f-46d9-9dab-75c8a2620d06 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] No waiting events found dispatching network-vif-unplugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:26:29 user nova-compute[71692]: WARNING nova.compute.manager [req-3e721b91-d0d9-4f1b-a455-e307743cfc22 req-4fd315d2-f99f-46d9-9dab-75c8a2620d06 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received unexpected event network-vif-unplugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance with vm_state active and task_state rescuing.
Apr 13 19:26:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Instance destroyed successfully.
Apr 13 19:26:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Attempting a stable device rescue
Apr 13 19:26:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71692) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 19:26:29 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Instance directory exists: not creating {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 19:26:29 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Creating image(s)
Apr 13 19:26:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "/opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "/opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "/opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:29 user nova-compute[71692]: DEBUG nova.objects.instance [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'trusted_certs' on Instance uuid 991871a0-3a4e-4014-b07f-3e8c49eeda5a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:26:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1594579454ae71dbf7df16d46e500c8fe7614a01" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1594579454ae71dbf7df16d46e500c8fe7614a01" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1594579454ae71dbf7df16d46e500c8fe7614a01.part --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1594579454ae71dbf7df16d46e500c8fe7614a01.part --force-share --output=json" returned: 0 in 0.226s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG nova.virt.images [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] bea83bdb-3ec8-4dda-9739-fabd8caa049f was qcow2, converting to raw {{(pid=71692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG nova.privsep.utils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1594579454ae71dbf7df16d46e500c8fe7614a01.part /opt/stack/data/nova/instances/_base/1594579454ae71dbf7df16d46e500c8fe7614a01.converted {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-639fe186-553c-4843-990f-bc8ed9a4ae9b req-b836b166-5754-45eb-8f03-31cbdecbdab2 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-639fe186-553c-4843-990f-bc8ed9a4ae9b req-b836b166-5754-45eb-8f03-31cbdecbdab2 service nova] Acquiring lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-639fe186-553c-4843-990f-bc8ed9a4ae9b req-b836b166-5754-45eb-8f03-31cbdecbdab2 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-639fe186-553c-4843-990f-bc8ed9a4ae9b req-b836b166-5754-45eb-8f03-31cbdecbdab2 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-639fe186-553c-4843-990f-bc8ed9a4ae9b req-b836b166-5754-45eb-8f03-31cbdecbdab2 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] No waiting events found dispatching network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:26:31 user nova-compute[71692]: WARNING nova.compute.manager [req-639fe186-553c-4843-990f-bc8ed9a4ae9b req-b836b166-5754-45eb-8f03-31cbdecbdab2 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received unexpected event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance with vm_state active and task_state rescuing.
Apr 13 19:26:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1594579454ae71dbf7df16d46e500c8fe7614a01.part /opt/stack/data/nova/instances/_base/1594579454ae71dbf7df16d46e500c8fe7614a01.converted" returned: 0 in 0.433s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1594579454ae71dbf7df16d46e500c8fe7614a01.converted --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1594579454ae71dbf7df16d46e500c8fe7614a01.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1594579454ae71dbf7df16d46e500c8fe7614a01" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.968s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "1594579454ae71dbf7df16d46e500c8fe7614a01" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1594579454ae71dbf7df16d46e500c8fe7614a01" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1594579454ae71dbf7df16d46e500c8fe7614a01 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1594579454ae71dbf7df16d46e500c8fe7614a01 --force-share --output=json" returned: 0 in 0.164s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1594579454ae71dbf7df16d46e500c8fe7614a01,backing_fmt=raw /opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a/disk.rescue {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1594579454ae71dbf7df16d46e500c8fe7614a01,backing_fmt=raw /opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a/disk.rescue" returned: 0 in 0.055s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "1594579454ae71dbf7df16d46e500c8fe7614a01" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG nova.objects.instance [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'migration_context' on Instance uuid 991871a0-3a4e-4014-b07f-3e8c49eeda5a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Start _get_guest_xml network_info=[{"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "vif_mac": "fa:16:3e:c8:17:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bea83bdb-3ec8-4dda-9739-fabd8caa049f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '94c2b289-8cdb-494d-8137-0f58ae654ed2', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLywANqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '991871a0-3a4e-4014-b07f-3e8c49eeda5a', 'attached_at': '', 'detached_at': '', 'volume_id': '313c34d8-f051-4710-8baf-f34af4471945', 'serial': '313c34d8-f051-4710-8baf-f34af4471945'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG nova.objects.instance [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'resources' on Instance uuid 991871a0-3a4e-4014-b07f-3e8c49eeda5a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:26:31 user nova-compute[71692]: DEBUG nova.objects.instance [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'numa_topology' on Instance uuid 991871a0-3a4e-4014-b07f-3e8c49eeda5a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:26:32 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:26:32 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.objects.instance [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'vcpu_model' on Instance uuid 991871a0-3a4e-4014-b07f-3e8c49eeda5a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLywANqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:26:32 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:26:32 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:26:32 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ebaddf-737b-499a-bdd7-5d2777788e15]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PLywANqO\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 19:26:32 user nova-compute[71692]: node.name = iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945
Apr 13 19:26:32 user nova-compute[71692]: node.tpgt = -1
Apr 13 19:26:32 user nova-compute[71692]: node.startup = automatic
Apr 13 19:26:32 user nova-compute[71692]: node.leading_login = No
Apr 13 19:26:32 user nova-compute[71692]: iface.iscsi_ifacename = default
Apr 13 19:26:32 user nova-compute[71692]: iface.net_ifacename = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.ipaddress = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.prefix_len = 0
Apr 13 19:26:32 user nova-compute[71692]: iface.hwaddress = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.transport_name = tcp
Apr 13 19:26:32 user nova-compute[71692]: iface.initiatorname = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.state = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.vlan_id = 0
Apr 13 19:26:32 user nova-compute[71692]: iface.vlan_priority = 0
Apr 13 19:26:32 user nova-compute[71692]: iface.vlan_state = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.iface_num = 0
Apr 13 19:26:32 user nova-compute[71692]: iface.mtu = 0
Apr 13 19:26:32 user nova-compute[71692]: iface.port = 0
Apr 13 19:26:32 user nova-compute[71692]: iface.bootproto = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.subnet_mask = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.gateway = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.dhcp_alt_client_id = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.dhcp_dns = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.dhcp_learn_iqn = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.dhcp_vendor_id_state = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.dhcp_vendor_id = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.dhcp_slp_da = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.fragmentation = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.gratuitous_arp = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.incoming_forwarding = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.tos_state = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.tos = 0
Apr 13 19:26:32 user nova-compute[71692]: iface.ttl = 0
Apr 13 19:26:32 user nova-compute[71692]: iface.delayed_ack = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.tcp_nagle = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.tcp_wsf_state = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.tcp_wsf = 0
Apr 13 19:26:32 user nova-compute[71692]: iface.tcp_timer_scale = 0
Apr 13 19:26:32 user nova-compute[71692]: iface.tcp_timestamp = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.redirect = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.def_task_mgmt_timeout = 0
Apr 13 19:26:32 user nova-compute[71692]: iface.header_digest = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.data_digest = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.immediate_data = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.initial_r2t = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.data_seq_inorder = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.data_pdu_inorder = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.erl = 0
Apr 13 19:26:32 user nova-compute[71692]: iface.max_receive_data_len = 0
Apr 13 19:26:32 user nova-compute[71692]: iface.first_burst_len = 0
Apr 13 19:26:32 user nova-compute[71692]: iface.max_outstanding_r2t = 0
Apr 13 19:26:32 user nova-compute[71692]: iface.max_burst_len = 0
Apr 13 19:26:32 user nova-compute[71692]: iface.chap_auth = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.bidi_chap = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.strict_login_compliance = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.discovery_auth = <empty>
Apr 13 19:26:32 user nova-compute[71692]: iface.discovery_logout = <empty>
Apr 13 19:26:32 user nova-compute[71692]: node.discovery_address = <empty>
Apr 13 19:26:32 user nova-compute[71692]: node.discovery_port = 0
Apr 13 19:26:32 user nova-compute[71692]: node.discovery_type = static
Apr 13 19:26:32 user nova-compute[71692]: node.session.initial_cmdsn = 0
Apr 13 19:26:32 user nova-compute[71692]: node.session.initial_login_retry_max = 8
Apr 13 19:26:32 user nova-compute[71692]: node.session.xmit_thread_priority = -20
Apr 13 19:26:32 user nova-compute[71692]: node.session.cmds_max = 128
Apr 13 19:26:32 user nova-compute[71692]: node.session.queue_depth = 32
Apr 13 19:26:32 user nova-compute[71692]: node.session.nr_sessions = 1
Apr 13 19:26:32 user nova-compute[71692]: node.session.auth.authmethod = CHAP
Apr 13 19:26:32 user nova-compute[71692]: node.session.auth.username = PLywANqO
Apr 13 19:26:32 user nova-compute[71692]: node.session.auth.password = ***
Apr 13 19:26:32 user nova-compute[71692]: node.session.auth.username_in = <empty>
Apr 13 19:26:32 user nova-compute[71692]: node.session.auth.password_in = <empty>
Apr 13 19:26:32 user nova-compute[71692]: node.session.auth.chap_algs = MD5
Apr 13 19:26:32 user nova-compute[71692]: node.session.timeo.replacement_timeout = 120
Apr 13 19:26:32 user nova-compute[71692]: node.session.err_timeo.abort_timeout = 15
Apr 13 19:26:32 user nova-compute[71692]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 19:26:32 user nova-compute[71692]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 19:26:32 user nova-compute[71692]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 19:26:32 user nova-compute[71692]: node.session.iscsi.FastAbort = Yes
Apr 13 19:26:32 user nova-compute[71692]: node.session.iscsi.InitialR2T = No
Apr 13 19:26:32 user nova-compute[71692]: node.session.iscsi.ImmediateData = Yes
Apr 13 19:26:32 user nova-compute[71692]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 19:26:32 user nova-compute[71692]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 19:26:32 user nova-compute[71692]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 19:26:32 user nova-compute[71692]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 19:26:32 user nova-compute[71692]: node.session.iscsi.MaxConnections = 1
Apr 13 19:26:32 user nova-compute[71692]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 19:26:32 user nova-compute[71692]: node.session.iscsi.ERL = 0
Apr 13 19:26:32 user nova-compute[71692]: node.session.scan = manual
Apr 13 19:26:32 user nova-compute[71692]: node.session.reopen_max = 0
Apr 13 19:26:32 user nova-compute[71692]: node.conn[0].address = 172.16.0.220
Apr 13 19:26:32 user nova-compute[71692]: node.conn[0].port = 3260
Apr 13 19:26:32 user nova-compute[71692]: node.conn[0].startup = manual
Apr 13 19:26:32 user nova-compute[71692]: node.conn[0].tcp.window_size = 524288
Apr 13 19:26:32 user nova-compute[71692]: node.conn[0].tcp.type_of_service = 0
Apr 13 19:26:32 user nova-compute[71692]: node.conn[0].timeo.logout_timeout = 15
Apr 13 19:26:32 user nova-compute[71692]: node.conn[0].timeo.login_timeout = 15
Apr 13 19:26:32 user nova-compute[71692]: node.conn[0].timeo.auth_timeout = 45
Apr 13 19:26:32 user nova-compute[71692]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 19:26:32 user nova-compute[71692]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 19:26:32 user nova-compute[71692]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 19:26:32 user nova-compute[71692]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 19:26:32 user nova-compute[71692]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 19:26:32 user nova-compute[71692]: node.conn[0].iscsi.DataDigest = None
Apr 13 19:26:32 user nova-compute[71692]: node.conn[0].iscsi.IFMarker = No
Apr 13 19:26:32 user nova-compute[71692]: node.conn[0].iscsi.OFMarker = No
Apr 13 19:26:32 user nova-compute[71692]: # END RECORD
Apr 13 19:26:32 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[170fd8dd-6c1a-40d7-9e3d-dd729af278b1]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2ab6b7-a901-463f-9c54-e28e43c8a9c9]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PLywANqO {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PLywANqO" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f6c7d8-2bc3-4e9d-b2e0-a809c28d4178]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PLywANqO'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a884d013-ed3a-439a-b8ba-42583d8dca3f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71443e1-2b83-4849-8f51-c65be1e8b83c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:26:32 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:26:32 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:26:32 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:26:32 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.165s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] HCTL ('33', '0', '0', 0) found on session 45 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0f6311-1a73-492f-a66b-22d5b77230dd]: (4, ('0 0 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Searching for a device in session 45 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLywANqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.199s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] <== connect_volume: return (200ms) {'type': 'block', 'scsi_wwn': '26562386465356365', 'path': '/dev/sdb'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562386465356365', 'path': '/dev/sdb'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-984612808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-984612808',id=37,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:24:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c00a7fcd6d3040e8b2db0448eeda93ad',ramdisk_id='',reservation_id='r-tflw5ozm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:24:53Z,user_data=None,user_id='dd604fa4d17b42b1abea8c2f2405b58d',uuid=991871a0-3a4e-4014-b07f-3e8c49eeda5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "vif_mac": "fa:16:3e:c8:17:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converting VIF {"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "vif_mac": "fa:16:3e:c8:17:3b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:17:3b,bridge_name='br-int',has_traffic_filtering=True,id=405a3575-62ce-4c5c-8090-40f2fabf7d61,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405a3575-62') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.objects.instance [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'pci_devices' on Instance uuid 991871a0-3a4e-4014-b07f-3e8c49eeda5a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:26:32 user nova-compute[71692]:   <uuid>991871a0-3a4e-4014-b07f-3e8c49eeda5a</uuid>
Apr 13 19:26:32 user nova-compute[71692]:   <name>instance-00000025</name>
Apr 13 19:26:32 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:26:32 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:26:32 user nova-compute[71692]:   <metadata>
Apr 13 19:26:32 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:26:32 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:26:32 user nova-compute[71692]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-984612808</nova:name>
Apr 13 19:26:32 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:26:32</nova:creationTime>
Apr 13 19:26:32 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:26:32 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:26:32 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:26:32 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:26:32 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:26:32 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:26:32 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:26:32 user nova-compute[71692]:       <nova:owner>
Apr 13 19:26:32 user nova-compute[71692]:         <nova:user uuid="dd604fa4d17b42b1abea8c2f2405b58d">tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member</nova:user>
Apr 13 19:26:32 user nova-compute[71692]:         <nova:project uuid="c00a7fcd6d3040e8b2db0448eeda93ad">tempest-ServerBootFromVolumeStableRescueTest-1051313256</nova:project>
Apr 13 19:26:32 user nova-compute[71692]:       </nova:owner>
Apr 13 19:26:32 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:26:32 user nova-compute[71692]:       <nova:ports>
Apr 13 19:26:32 user nova-compute[71692]:         <nova:port uuid="405a3575-62ce-4c5c-8090-40f2fabf7d61">
Apr 13 19:26:32 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 19:26:32 user nova-compute[71692]:         </nova:port>
Apr 13 19:26:32 user nova-compute[71692]:       </nova:ports>
Apr 13 19:26:32 user nova-compute[71692]:     </nova:instance>
Apr 13 19:26:32 user nova-compute[71692]:   </metadata>
Apr 13 19:26:32 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:26:32 user nova-compute[71692]:     <system>
Apr 13 19:26:32 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:26:32 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:26:32 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:26:32 user nova-compute[71692]:       <entry name="serial">991871a0-3a4e-4014-b07f-3e8c49eeda5a</entry>
Apr 13 19:26:32 user nova-compute[71692]:       <entry name="uuid">991871a0-3a4e-4014-b07f-3e8c49eeda5a</entry>
Apr 13 19:26:32 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:26:32 user nova-compute[71692]:     </system>
Apr 13 19:26:32 user nova-compute[71692]:   </sysinfo>
Apr 13 19:26:32 user nova-compute[71692]:   <os>
Apr 13 19:26:32 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:26:32 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:26:32 user nova-compute[71692]:   </os>
Apr 13 19:26:32 user nova-compute[71692]:   <features>
Apr 13 19:26:32 user nova-compute[71692]:     <acpi/>
Apr 13 19:26:32 user nova-compute[71692]:     <apic/>
Apr 13 19:26:32 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:26:32 user nova-compute[71692]:   </features>
Apr 13 19:26:32 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:26:32 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:26:32 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:26:32 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:26:32 user nova-compute[71692]:   </clock>
Apr 13 19:26:32 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:26:32 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:26:32 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:26:32 user nova-compute[71692]:   </cpu>
Apr 13 19:26:32 user nova-compute[71692]:   <devices>
Apr 13 19:26:32 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:26:32 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:26:32 user nova-compute[71692]:       <source dev="/dev/sdb"/>
Apr 13 19:26:32 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:26:32 user nova-compute[71692]:       <serial>313c34d8-f051-4710-8baf-f34af4471945</serial>
Apr 13 19:26:32 user nova-compute[71692]:     </disk>
Apr 13 19:26:32 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:26:32 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:26:32 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a/disk.rescue"/>
Apr 13 19:26:32 user nova-compute[71692]:       <target dev="vdb" bus="virtio"/>
Apr 13 19:26:32 user nova-compute[71692]:       <boot order="1"/>
Apr 13 19:26:32 user nova-compute[71692]:     </disk>
Apr 13 19:26:32 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:26:32 user nova-compute[71692]:       <mac address="fa:16:3e:c8:17:3b"/>
Apr 13 19:26:32 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:26:32 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:26:32 user nova-compute[71692]:       <target dev="tap405a3575-62"/>
Apr 13 19:26:32 user nova-compute[71692]:     </interface>
Apr 13 19:26:32 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:26:32 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a/console.log" append="off"/>
Apr 13 19:26:32 user nova-compute[71692]:     </serial>
Apr 13 19:26:32 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:26:32 user nova-compute[71692]:     <video>
Apr 13 19:26:32 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:26:32 user nova-compute[71692]:     </video>
Apr 13 19:26:32 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:26:32 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:26:32 user nova-compute[71692]:     </rng>
Apr 13 19:26:32 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:26:32 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:26:32 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:26:32 user nova-compute[71692]:     </memballoon>
Apr 13 19:26:32 user nova-compute[71692]:   </devices>
Apr 13 19:26:32 user nova-compute[71692]: </domain>
Apr 13 19:26:32 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:26:32 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Instance destroyed successfully.
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:26:32 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] No VIF found with MAC fa:16:3e:c8:17:3b, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:26:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:34 user nova-compute[71692]: DEBUG nova.compute.manager [req-f130ea94-9e5a-44b7-a8ca-676c3a10ae66 req-c0c40f76-1e81-431b-a7d6-2cddbe1c6047 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:26:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f130ea94-9e5a-44b7-a8ca-676c3a10ae66 req-c0c40f76-1e81-431b-a7d6-2cddbe1c6047 service nova] Acquiring lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f130ea94-9e5a-44b7-a8ca-676c3a10ae66 req-c0c40f76-1e81-431b-a7d6-2cddbe1c6047 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f130ea94-9e5a-44b7-a8ca-676c3a10ae66 req-c0c40f76-1e81-431b-a7d6-2cddbe1c6047 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:34 user nova-compute[71692]: DEBUG nova.compute.manager [req-f130ea94-9e5a-44b7-a8ca-676c3a10ae66 req-c0c40f76-1e81-431b-a7d6-2cddbe1c6047 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] No waiting events found dispatching network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:26:34 user nova-compute[71692]: WARNING nova.compute.manager [req-f130ea94-9e5a-44b7-a8ca-676c3a10ae66 req-c0c40f76-1e81-431b-a7d6-2cddbe1c6047 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received unexpected event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance with vm_state active and task_state rescuing.
Apr 13 19:26:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Removed pending event for 991871a0-3a4e-4014-b07f-3e8c49eeda5a due to event {{(pid=71692) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 19:26:36 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413996.0379725, 991871a0-3a4e-4014-b07f-3e8c49eeda5a => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:26:36 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] VM Resumed (Lifecycle Event)
Apr 13 19:26:36 user nova-compute[71692]: DEBUG nova.compute.manager [None req-622a4150-ccd7-44cd-9184-0689769f60dd tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:26:36 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:26:36 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:26:36 user nova-compute[71692]: DEBUG nova.compute.manager [req-43484b3b-2272-4d4c-a197-65cc7dc88ee9 req-92262ca4-fabf-40b3-9b15-2f7e7b2912df service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:26:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-43484b3b-2272-4d4c-a197-65cc7dc88ee9 req-92262ca4-fabf-40b3-9b15-2f7e7b2912df service nova] Acquiring lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-43484b3b-2272-4d4c-a197-65cc7dc88ee9 req-92262ca4-fabf-40b3-9b15-2f7e7b2912df service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-43484b3b-2272-4d4c-a197-65cc7dc88ee9 req-92262ca4-fabf-40b3-9b15-2f7e7b2912df service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:36 user nova-compute[71692]: DEBUG nova.compute.manager [req-43484b3b-2272-4d4c-a197-65cc7dc88ee9 req-92262ca4-fabf-40b3-9b15-2f7e7b2912df service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] No waiting events found dispatching network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:26:36 user nova-compute[71692]: WARNING nova.compute.manager [req-43484b3b-2272-4d4c-a197-65cc7dc88ee9 req-92262ca4-fabf-40b3-9b15-2f7e7b2912df service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received unexpected event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance with vm_state active and task_state rescuing.
Apr 13 19:26:36 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 19:26:36 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681413996.0452757, 991871a0-3a4e-4014-b07f-3e8c49eeda5a => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:26:36 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] VM Started (Lifecycle Event)
Apr 13 19:26:36 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:26:36 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:26:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:26:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:49 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:26:49 user nova-compute[71692]: INFO nova.compute.claims [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Claim successful on node user
Apr 13 19:26:49 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:26:49 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:26:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG nova.network.neutron [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:26:50 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:26:50 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG nova.policy [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:26:50 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Creating image(s)
Apr 13 19:26:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "/opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "/opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "/opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.040s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "8359687d5374c46184ce432418d27607b989e209" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "8359687d5374c46184ce432418d27607b989e209" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209.part --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209.part --force-share --output=json" returned: 0 in 0.154s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG nova.virt.images [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] dc0ead7b-fade-4a75-ad11-302ad2eb923b was qcow2, converting to raw {{(pid=71692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG nova.privsep.utils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209.part /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209.converted {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "9ef84353-ff2d-4835-b160-e801179c0c9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "9ef84353-ff2d-4835-b160-e801179c0c9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG nova.compute.manager [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG nova.network.neutron [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Successfully created port: 18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:26:51 user nova-compute[71692]: INFO nova.compute.claims [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Claim successful on node user
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209.part /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209.converted" returned: 0 in 0.231s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209.converted --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209.converted --force-share --output=json" returned: 0 in 0.151s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "8359687d5374c46184ce432418d27607b989e209" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.954s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209 --force-share --output=json" returned: 0 in 0.151s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "8359687d5374c46184ce432418d27607b989e209" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "8359687d5374c46184ce432418d27607b989e209" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:26:51 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.network.neutron [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.compute.manager [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209 --force-share --output=json" returned: 0 in 0.153s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209,backing_fmt=raw /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:51 user nova-compute[71692]: INFO nova.virt.block_device [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Booting with volume snapshot 52578be7-3781-4634-a9e5-84b77498fc7a at /dev/vda
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209,backing_fmt=raw /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk 1073741824" returned: 0 in 0.063s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "8359687d5374c46184ce432418d27607b989e209" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.policy [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.network.neutron [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Successfully updated port: 18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209 --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Checking if we can resize image /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.compute.manager [req-2d047063-67f0-4db5-80ff-61169fc91cf8 req-86785ade-809a-4eab-870d-36c624547d3b service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received event network-changed-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.compute.manager [req-2d047063-67f0-4db5-80ff-61169fc91cf8 req-86785ade-809a-4eab-870d-36c624547d3b service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Refreshing instance network info cache due to event network-changed-18d17551-39ea-401c-95cf-acfdafb210d5. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2d047063-67f0-4db5-80ff-61169fc91cf8 req-86785ade-809a-4eab-870d-36c624547d3b service nova] Acquiring lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2d047063-67f0-4db5-80ff-61169fc91cf8 req-86785ade-809a-4eab-870d-36c624547d3b service nova] Acquired lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.network.neutron [req-2d047063-67f0-4db5-80ff-61169fc91cf8 req-86785ade-809a-4eab-870d-36c624547d3b service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Refreshing network info cache for port 18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.network.neutron [req-2d047063-67f0-4db5-80ff-61169fc91cf8 req-86785ade-809a-4eab-870d-36c624547d3b service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Cannot resize image /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.objects.instance [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'migration_context' on Instance uuid 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Ensure instance console log exists: /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.network.neutron [req-2d047063-67f0-4db5-80ff-61169fc91cf8 req-86785ade-809a-4eab-870d-36c624547d3b service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2d047063-67f0-4db5-80ff-61169fc91cf8 req-86785ade-809a-4eab-870d-36c624547d3b service nova] Releasing lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquired lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.network.neutron [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.network.neutron [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.network.neutron [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Updating instance_info_cache with network_info: [{"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Releasing lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Instance network_info: |[{"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Start _get_guest_xml network_info=[{"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T19:26:47Z,direct_url=<?>,disk_format='qcow2',id=dc0ead7b-fade-4a75-ad11-302ad2eb923b,min_disk=0,min_ram=0,name='tempest-scenario-img--293161390',owner='ba0e42217cc44413951d6d5a87dbb886',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T19:26:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'dc0ead7b-fade-4a75-ad11-302ad2eb923b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:26:52 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:26:52 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T19:26:47Z,direct_url=<?>,disk_format='qcow2',id=dc0ead7b-fade-4a75-ad11-302ad2eb923b,min_disk=0,min_ram=0,name='tempest-scenario-img--293161390',owner='ba0e42217cc44413951d6d5a87dbb886',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T19:26:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-304929672',display_name='tempest-TestMinimumBasicScenario-server-304929672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-304929672',id=39,image_ref='dc0ead7b-fade-4a75-ad11-302ad2eb923b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjiNQrMZkLrv/EsYiTKx9Bso1DHqJYptOtxcSQw4ewhiYzdhDtT3eKqKNXIIMToEcZ9WUG6UoWwxRLW6EfnAJANQV8bUtuFoVgIl7T4cD+d2MiwUmR5kNz16P2NI+rGLA==',key_name='tempest-TestMinimumBasicScenario-256533708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba0e42217cc44413951d6d5a87dbb886',ramdisk_id='',reservation_id='r-lcu3iow5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dc0ead7b-fade-4a75-ad11-302ad2eb923b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-8202894',owner_user_name='tempest-TestMinimumBasicScenario-8202894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:26:50Z,user_data=None,user_id='9b9ed2da2b4949269c2df77766a1835f',uuid=595c2a08-28fd-4076-b7bb-b9b0ac4349e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converting VIF {"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:d7:6a,bridge_name='br-int',has_traffic_filtering=True,id=18d17551-39ea-401c-95cf-acfdafb210d5,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d17551-39') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.objects.instance [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'pci_devices' on Instance uuid 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:26:52 user nova-compute[71692]:   <uuid>595c2a08-28fd-4076-b7bb-b9b0ac4349e6</uuid>
Apr 13 19:26:52 user nova-compute[71692]:   <name>instance-00000027</name>
Apr 13 19:26:52 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:26:52 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:26:52 user nova-compute[71692]:   <metadata>
Apr 13 19:26:52 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:26:52 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:26:52 user nova-compute[71692]:       <nova:name>tempest-TestMinimumBasicScenario-server-304929672</nova:name>
Apr 13 19:26:52 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:26:52</nova:creationTime>
Apr 13 19:26:52 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:26:52 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:26:52 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:26:52 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:26:52 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:26:52 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:26:52 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:26:52 user nova-compute[71692]:       <nova:owner>
Apr 13 19:26:52 user nova-compute[71692]:         <nova:user uuid="9b9ed2da2b4949269c2df77766a1835f">tempest-TestMinimumBasicScenario-8202894-project-member</nova:user>
Apr 13 19:26:52 user nova-compute[71692]:         <nova:project uuid="ba0e42217cc44413951d6d5a87dbb886">tempest-TestMinimumBasicScenario-8202894</nova:project>
Apr 13 19:26:52 user nova-compute[71692]:       </nova:owner>
Apr 13 19:26:52 user nova-compute[71692]:       <nova:root type="image" uuid="dc0ead7b-fade-4a75-ad11-302ad2eb923b"/>
Apr 13 19:26:52 user nova-compute[71692]:       <nova:ports>
Apr 13 19:26:52 user nova-compute[71692]:         <nova:port uuid="18d17551-39ea-401c-95cf-acfdafb210d5">
Apr 13 19:26:52 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 19:26:52 user nova-compute[71692]:         </nova:port>
Apr 13 19:26:52 user nova-compute[71692]:       </nova:ports>
Apr 13 19:26:52 user nova-compute[71692]:     </nova:instance>
Apr 13 19:26:52 user nova-compute[71692]:   </metadata>
Apr 13 19:26:52 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:26:52 user nova-compute[71692]:     <system>
Apr 13 19:26:52 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:26:52 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:26:52 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:26:52 user nova-compute[71692]:       <entry name="serial">595c2a08-28fd-4076-b7bb-b9b0ac4349e6</entry>
Apr 13 19:26:52 user nova-compute[71692]:       <entry name="uuid">595c2a08-28fd-4076-b7bb-b9b0ac4349e6</entry>
Apr 13 19:26:52 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:26:52 user nova-compute[71692]:     </system>
Apr 13 19:26:52 user nova-compute[71692]:   </sysinfo>
Apr 13 19:26:52 user nova-compute[71692]:   <os>
Apr 13 19:26:52 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:26:52 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:26:52 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:26:52 user nova-compute[71692]:   </os>
Apr 13 19:26:52 user nova-compute[71692]:   <features>
Apr 13 19:26:52 user nova-compute[71692]:     <acpi/>
Apr 13 19:26:52 user nova-compute[71692]:     <apic/>
Apr 13 19:26:52 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:26:52 user nova-compute[71692]:   </features>
Apr 13 19:26:52 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:26:52 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:26:52 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:26:52 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:26:52 user nova-compute[71692]:   </clock>
Apr 13 19:26:52 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:26:52 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:26:52 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:26:52 user nova-compute[71692]:   </cpu>
Apr 13 19:26:52 user nova-compute[71692]:   <devices>
Apr 13 19:26:52 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:26:52 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:26:52 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk"/>
Apr 13 19:26:52 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:26:52 user nova-compute[71692]:     </disk>
Apr 13 19:26:52 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:26:52 user nova-compute[71692]:       <mac address="fa:16:3e:7b:d7:6a"/>
Apr 13 19:26:52 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:26:52 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:26:52 user nova-compute[71692]:       <target dev="tap18d17551-39"/>
Apr 13 19:26:52 user nova-compute[71692]:     </interface>
Apr 13 19:26:52 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:26:52 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/console.log" append="off"/>
Apr 13 19:26:52 user nova-compute[71692]:     </serial>
Apr 13 19:26:52 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:26:52 user nova-compute[71692]:     <video>
Apr 13 19:26:52 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:26:52 user nova-compute[71692]:     </video>
Apr 13 19:26:52 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:26:52 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:26:52 user nova-compute[71692]:     </rng>
Apr 13 19:26:52 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:26:52 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:26:52 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:26:52 user nova-compute[71692]:     </memballoon>
Apr 13 19:26:52 user nova-compute[71692]:   </devices>
Apr 13 19:26:52 user nova-compute[71692]: </domain>
Apr 13 19:26:52 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-304929672',display_name='tempest-TestMinimumBasicScenario-server-304929672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-304929672',id=39,image_ref='dc0ead7b-fade-4a75-ad11-302ad2eb923b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjiNQrMZkLrv/EsYiTKx9Bso1DHqJYptOtxcSQw4ewhiYzdhDtT3eKqKNXIIMToEcZ9WUG6UoWwxRLW6EfnAJANQV8bUtuFoVgIl7T4cD+d2MiwUmR5kNz16P2NI+rGLA==',key_name='tempest-TestMinimumBasicScenario-256533708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba0e42217cc44413951d6d5a87dbb886',ramdisk_id='',reservation_id='r-lcu3iow5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dc0ead7b-fade-4a75-ad11-302ad2eb923b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-8202894',owner_user_name='tempest-TestMinimumBasicScenario-8202894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:26:50Z,user_data=None,user_id='9b9ed2da2b4949269c2df77766a1835f',uuid=595c2a08-28fd-4076-b7bb-b9b0ac4349e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converting VIF {"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:d7:6a,bridge_name='br-int',has_traffic_filtering=True,id=18d17551-39ea-401c-95cf-acfdafb210d5,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d17551-39') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG os_vif [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:d7:6a,bridge_name='br-int',has_traffic_filtering=True,id=18d17551-39ea-401c-95cf-acfdafb210d5,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d17551-39') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18d17551-39, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18d17551-39, col_values=(('external_ids', {'iface-id': '18d17551-39ea-401c-95cf-acfdafb210d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:d7:6a', 'vm-uuid': '595c2a08-28fd-4076-b7bb-b9b0ac4349e6'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:52 user nova-compute[71692]: INFO os_vif [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:d7:6a,bridge_name='br-int',has_traffic_filtering=True,id=18d17551-39ea-401c-95cf-acfdafb210d5,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d17551-39')
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.network.neutron [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Successfully created port: 4afa859b-b4dd-4a45-aace-f4ad471db0d6 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:26:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] No VIF found with MAC fa:16:3e:7b:d7:6a, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG nova.network.neutron [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Successfully updated port: 4afa859b-b4dd-4a45-aace-f4ad471db0d6 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "refresh_cache-9ef84353-ff2d-4835-b160-e801179c0c9c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquired lock "refresh_cache-9ef84353-ff2d-4835-b160-e801179c0c9c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG nova.network.neutron [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-edcdea36-6774-437d-9cf9-9f8bf6cc4f2b req-79be9f0d-70eb-4642-b4c2-957e0372a67f service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Received event network-changed-4afa859b-b4dd-4a45-aace-f4ad471db0d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-edcdea36-6774-437d-9cf9-9f8bf6cc4f2b req-79be9f0d-70eb-4642-b4c2-957e0372a67f service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Refreshing instance network info cache due to event network-changed-4afa859b-b4dd-4a45-aace-f4ad471db0d6. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-edcdea36-6774-437d-9cf9-9f8bf6cc4f2b req-79be9f0d-70eb-4642-b4c2-957e0372a67f service nova] Acquiring lock "refresh_cache-9ef84353-ff2d-4835-b160-e801179c0c9c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG nova.network.neutron [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Updating instance_info_cache with network_info: [{"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG nova.network.neutron [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Updating instance_info_cache with network_info: [{"id": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "address": "fa:16:3e:c0:b0:14", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afa859b-b4", "ovs_interfaceid": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Releasing lock "refresh_cache-9ef84353-ff2d-4835-b160-e801179c0c9c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG nova.compute.manager [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Instance network_info: |[{"id": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "address": "fa:16:3e:c0:b0:14", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afa859b-b4", "ovs_interfaceid": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-edcdea36-6774-437d-9cf9-9f8bf6cc4f2b req-79be9f0d-70eb-4642-b4c2-957e0372a67f service nova] Acquired lock "refresh_cache-9ef84353-ff2d-4835-b160-e801179c0c9c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG nova.network.neutron [req-edcdea36-6774-437d-9cf9-9f8bf6cc4f2b req-79be9f0d-70eb-4642-b4c2-957e0372a67f service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Refreshing network info cache for port 4afa859b-b4dd-4a45-aace-f4ad471db0d6 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-46b55057-c67b-4ebf-9264-783ad4275307 req-8867f6a8-fa30-428d-9ed3-9861550b5a85 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received event network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:26:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-46b55057-c67b-4ebf-9264-783ad4275307 req-8867f6a8-fa30-428d-9ed3-9861550b5a85 service nova] Acquiring lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-46b55057-c67b-4ebf-9264-783ad4275307 req-8867f6a8-fa30-428d-9ed3-9861550b5a85 service nova] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-46b55057-c67b-4ebf-9264-783ad4275307 req-8867f6a8-fa30-428d-9ed3-9861550b5a85 service nova] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:54 user nova-compute[71692]: DEBUG nova.compute.manager [req-46b55057-c67b-4ebf-9264-783ad4275307 req-8867f6a8-fa30-428d-9ed3-9861550b5a85 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] No waiting events found dispatching network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:26:54 user nova-compute[71692]: WARNING nova.compute.manager [req-46b55057-c67b-4ebf-9264-783ad4275307 req-8867f6a8-fa30-428d-9ed3-9861550b5a85 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received unexpected event network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 for instance with vm_state building and task_state spawning.
Apr 13 19:26:54 user nova-compute[71692]: DEBUG nova.network.neutron [req-edcdea36-6774-437d-9cf9-9f8bf6cc4f2b req-79be9f0d-70eb-4642-b4c2-957e0372a67f service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Updated VIF entry in instance network info cache for port 4afa859b-b4dd-4a45-aace-f4ad471db0d6. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:26:54 user nova-compute[71692]: DEBUG nova.network.neutron [req-edcdea36-6774-437d-9cf9-9f8bf6cc4f2b req-79be9f0d-70eb-4642-b4c2-957e0372a67f service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Updating instance_info_cache with network_info: [{"id": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "address": "fa:16:3e:c0:b0:14", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afa859b-b4", "ovs_interfaceid": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:26:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-edcdea36-6774-437d-9cf9-9f8bf6cc4f2b req-79be9f0d-70eb-4642-b4c2-957e0372a67f service nova] Releasing lock "refresh_cache-9ef84353-ff2d-4835-b160-e801179c0c9c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:26:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:55 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:26:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:55 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:26:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:55 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:26:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:55 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414016.0757945, 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:26:56 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] VM Resumed (Lifecycle Event)
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:26:56 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Instance spawned successfully.
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:26:56 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414016.0869114, 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:26:56 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] VM Started (Lifecycle Event)
Apr 13 19:26:56 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:26:56 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-e9d86c47-e3fd-4ad3-a1cd-0154629176b1 req-ee3bd699-825f-4f88-8b59-b0147b48b159 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received event network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e9d86c47-e3fd-4ad3-a1cd-0154629176b1 req-ee3bd699-825f-4f88-8b59-b0147b48b159 service nova] Acquiring lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e9d86c47-e3fd-4ad3-a1cd-0154629176b1 req-ee3bd699-825f-4f88-8b59-b0147b48b159 service nova] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e9d86c47-e3fd-4ad3-a1cd-0154629176b1 req-ee3bd699-825f-4f88-8b59-b0147b48b159 service nova] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-e9d86c47-e3fd-4ad3-a1cd-0154629176b1 req-ee3bd699-825f-4f88-8b59-b0147b48b159 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] No waiting events found dispatching network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:26:56 user nova-compute[71692]: WARNING nova.compute.manager [req-e9d86c47-e3fd-4ad3-a1cd-0154629176b1 req-ee3bd699-825f-4f88-8b59-b0147b48b159 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received unexpected event network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 for instance with vm_state building and task_state spawning.
Apr 13 19:26:56 user nova-compute[71692]: INFO nova.compute.manager [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Took 6.38 seconds to spawn the instance on the hypervisor.
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:26:56 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:26:56 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8467MB free_disk=25.960933685302734GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:26:56 user nova-compute[71692]: INFO nova.compute.manager [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Took 7.04 seconds to build instance.
Apr 13 19:26:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8e848eda-6821-46da-976b-8e55dcfc300b tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.144s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 9ef84353-ff2d-4835-b160-e801179c0c9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:26:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG os_brick.utils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1278e6-7228-43fd-be15-1ec44105b58f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9c1a8e-9923-485e-b8fd-9343c7000bac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6844696-d496-45aa-a6a7-d2b5a5f76799]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa30bbc-6740-49ab-b3d7-03aa538897b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:26:57 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9575d999-1b41-4064-873a-5be686e4e672]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG os_brick.utils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Updating existing volume attachment record: d73023c6-9078-46d9-a932-34b05e3894f9 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:26:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:27:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.compute.manager [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:27:02 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Creating image(s)
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Did not create local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Ensure instance console log exists: /opt/stack/data/nova/instances/9ef84353-ff2d-4835-b160-e801179c0c9c/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Start _get_guest_xml network_info=[{"id": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "address": "fa:16:3e:c0:b0:14", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afa859b-b4", "ovs_interfaceid": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-13T19:26:48Z,direct_url=<?>,disk_format='qcow2',id=a6c0ca1e-e429-492c-9775-cc28706bb32b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-620525499',owner='a5231d999e51417ebe91927707bfd2bd',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-13T19:26:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'd73023c6-9078-46d9-a932-34b05e3894f9', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXwGOnHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9ef84353-ff2d-4835-b160-e801179c0c9c', 'attached_at': '', 'detached_at': '', 'volume_id': '2cc14048-5307-4fd4-8677-339648022ed5', 'serial': '2cc14048-5307-4fd4-8677-339648022ed5'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:27:02 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:27:02 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-13T19:26:48Z,direct_url=<?>,disk_format='qcow2',id=a6c0ca1e-e429-492c-9775-cc28706bb32b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-620525499',owner='a5231d999e51417ebe91927707bfd2bd',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-13T19:26:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXwGOnHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:27:02 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:27:02 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:27:02 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff93cdb2-93fb-45f2-9af6-1329f7e51b60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:27:02 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b16b4f-4c37-4ec9-9c97-ef381c6db303]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5] added
Apr 13 19:27:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa68771-db19-47cc-b5a9-79dc26aedd36]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d244a78d-7522-496d-9e49-fc2ac4e6663f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jXwGOnHq {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jXwGOnHq" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62f745e-1069-4b55-b203-5e6ebfeff8ee]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jXwGOnHq'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc803e3c-a48d-4d62-914a-b6cd37b3be24]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[038878ab-877d-4aef-981e-ad8fe55465e0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:27:02 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:27:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:27:02 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:27:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[590543d6-dbde-441a-9048-f941c63a184d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5, portal: 172.16.0.220,3260]
Apr 13 19:27:02 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5, portal: 172.16.0.220,3260] successful.
Apr 13 19:27:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04c76ef-e90f-4e0f-afc6-714c6cff1981]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e370e9c4-ac66-40de-892a-2d7424c78034]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:27:02 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:27:02 user nova-compute[71692]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 (non-flash)
Apr 13 19:27:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:27:02 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:27:02 user nova-compute[71692]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 (non-flash)
Apr 13 19:27:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb14441-345a-459f-97db-8f502af1abd5]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:27:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXwGOnHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23338336438333136', 'path': '/dev/sdd'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338336438333136', 'path': '/dev/sdd'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-524715520',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-524715520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-524715520',id=40,image_ref='a6c0ca1e-e429-492c-9775-cc28706bb32b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-kkr1mndu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1717000141',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:26:52Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=9ef84353-ff2d-4835-b160-e801179c0c9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "address": "fa:16:3e:c0:b0:14", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afa859b-b4", "ovs_interfaceid": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "address": "fa:16:3e:c0:b0:14", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afa859b-b4", "ovs_interfaceid": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b0:14,bridge_name='br-int',has_traffic_filtering=True,id=4afa859b-b4dd-4a45-aace-f4ad471db0d6,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4afa859b-b4') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG nova.objects.instance [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ef84353-ff2d-4835-b160-e801179c0c9c {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:27:03 user nova-compute[71692]:   <uuid>9ef84353-ff2d-4835-b160-e801179c0c9c</uuid>
Apr 13 19:27:03 user nova-compute[71692]:   <name>instance-00000028</name>
Apr 13 19:27:03 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:27:03 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:27:03 user nova-compute[71692]:   <metadata>
Apr 13 19:27:03 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:27:03 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:27:03 user nova-compute[71692]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-524715520</nova:name>
Apr 13 19:27:03 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:27:02</nova:creationTime>
Apr 13 19:27:03 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:27:03 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:27:03 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:27:03 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:27:03 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:27:03 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:27:03 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:27:03 user nova-compute[71692]:       <nova:owner>
Apr 13 19:27:03 user nova-compute[71692]:         <nova:user uuid="526d9c809b81418d89da662f973a1bdc">tempest-TestVolumeBootPattern-1717000141-project-member</nova:user>
Apr 13 19:27:03 user nova-compute[71692]:         <nova:project uuid="a5231d999e51417ebe91927707bfd2bd">tempest-TestVolumeBootPattern-1717000141</nova:project>
Apr 13 19:27:03 user nova-compute[71692]:       </nova:owner>
Apr 13 19:27:03 user nova-compute[71692]:       <nova:root type="image" uuid="a6c0ca1e-e429-492c-9775-cc28706bb32b"/>
Apr 13 19:27:03 user nova-compute[71692]:       <nova:ports>
Apr 13 19:27:03 user nova-compute[71692]:         <nova:port uuid="4afa859b-b4dd-4a45-aace-f4ad471db0d6">
Apr 13 19:27:03 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 19:27:03 user nova-compute[71692]:         </nova:port>
Apr 13 19:27:03 user nova-compute[71692]:       </nova:ports>
Apr 13 19:27:03 user nova-compute[71692]:     </nova:instance>
Apr 13 19:27:03 user nova-compute[71692]:   </metadata>
Apr 13 19:27:03 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:27:03 user nova-compute[71692]:     <system>
Apr 13 19:27:03 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:27:03 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:27:03 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:27:03 user nova-compute[71692]:       <entry name="serial">9ef84353-ff2d-4835-b160-e801179c0c9c</entry>
Apr 13 19:27:03 user nova-compute[71692]:       <entry name="uuid">9ef84353-ff2d-4835-b160-e801179c0c9c</entry>
Apr 13 19:27:03 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:27:03 user nova-compute[71692]:     </system>
Apr 13 19:27:03 user nova-compute[71692]:   </sysinfo>
Apr 13 19:27:03 user nova-compute[71692]:   <os>
Apr 13 19:27:03 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:27:03 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:27:03 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:27:03 user nova-compute[71692]:   </os>
Apr 13 19:27:03 user nova-compute[71692]:   <features>
Apr 13 19:27:03 user nova-compute[71692]:     <acpi/>
Apr 13 19:27:03 user nova-compute[71692]:     <apic/>
Apr 13 19:27:03 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:27:03 user nova-compute[71692]:   </features>
Apr 13 19:27:03 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:27:03 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:27:03 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:27:03 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:27:03 user nova-compute[71692]:   </clock>
Apr 13 19:27:03 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:27:03 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:27:03 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:27:03 user nova-compute[71692]:   </cpu>
Apr 13 19:27:03 user nova-compute[71692]:   <devices>
Apr 13 19:27:03 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:27:03 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:27:03 user nova-compute[71692]:       <source dev="/dev/sdd"/>
Apr 13 19:27:03 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:27:03 user nova-compute[71692]:       <serial>2cc14048-5307-4fd4-8677-339648022ed5</serial>
Apr 13 19:27:03 user nova-compute[71692]:     </disk>
Apr 13 19:27:03 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:27:03 user nova-compute[71692]:       <mac address="fa:16:3e:c0:b0:14"/>
Apr 13 19:27:03 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:27:03 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:27:03 user nova-compute[71692]:       <target dev="tap4afa859b-b4"/>
Apr 13 19:27:03 user nova-compute[71692]:     </interface>
Apr 13 19:27:03 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:27:03 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/9ef84353-ff2d-4835-b160-e801179c0c9c/console.log" append="off"/>
Apr 13 19:27:03 user nova-compute[71692]:     </serial>
Apr 13 19:27:03 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:27:03 user nova-compute[71692]:     <video>
Apr 13 19:27:03 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:27:03 user nova-compute[71692]:     </video>
Apr 13 19:27:03 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:27:03 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:27:03 user nova-compute[71692]:     </rng>
Apr 13 19:27:03 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:27:03 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:27:03 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:27:03 user nova-compute[71692]:     </memballoon>
Apr 13 19:27:03 user nova-compute[71692]:   </devices>
Apr 13 19:27:03 user nova-compute[71692]: </domain>
Apr 13 19:27:03 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-524715520',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-524715520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-524715520',id=40,image_ref='a6c0ca1e-e429-492c-9775-cc28706bb32b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-kkr1mndu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1717000141',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:26:52Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=9ef84353-ff2d-4835-b160-e801179c0c9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "address": "fa:16:3e:c0:b0:14", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afa859b-b4", "ovs_interfaceid": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "address": "fa:16:3e:c0:b0:14", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afa859b-b4", "ovs_interfaceid": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b0:14,bridge_name='br-int',has_traffic_filtering=True,id=4afa859b-b4dd-4a45-aace-f4ad471db0d6,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4afa859b-b4') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG os_vif [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b0:14,bridge_name='br-int',has_traffic_filtering=True,id=4afa859b-b4dd-4a45-aace-f4ad471db0d6,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4afa859b-b4') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4afa859b-b4, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4afa859b-b4, col_values=(('external_ids', {'iface-id': '4afa859b-b4dd-4a45-aace-f4ad471db0d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:b0:14', 'vm-uuid': '9ef84353-ff2d-4835-b160-e801179c0c9c'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:03 user nova-compute[71692]: INFO os_vif [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b0:14,bridge_name='br-int',has_traffic_filtering=True,id=4afa859b-b4dd-4a45-aace-f4ad471db0d6,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4afa859b-b4')
Apr 13 19:27:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:27:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] No VIF found with MAC fa:16:3e:c0:b0:14, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:27:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:05 user nova-compute[71692]: DEBUG nova.compute.manager [req-5b3c082b-bbfc-4461-9c6f-faed4406beff req-e9d9cd8f-4ff4-4b6e-95ad-df2b87e7be86 service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Received event network-vif-plugged-4afa859b-b4dd-4a45-aace-f4ad471db0d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:27:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5b3c082b-bbfc-4461-9c6f-faed4406beff req-e9d9cd8f-4ff4-4b6e-95ad-df2b87e7be86 service nova] Acquiring lock "9ef84353-ff2d-4835-b160-e801179c0c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:27:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5b3c082b-bbfc-4461-9c6f-faed4406beff req-e9d9cd8f-4ff4-4b6e-95ad-df2b87e7be86 service nova] Lock "9ef84353-ff2d-4835-b160-e801179c0c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:27:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5b3c082b-bbfc-4461-9c6f-faed4406beff req-e9d9cd8f-4ff4-4b6e-95ad-df2b87e7be86 service nova] Lock "9ef84353-ff2d-4835-b160-e801179c0c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:27:05 user nova-compute[71692]: DEBUG nova.compute.manager [req-5b3c082b-bbfc-4461-9c6f-faed4406beff req-e9d9cd8f-4ff4-4b6e-95ad-df2b87e7be86 service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] No waiting events found dispatching network-vif-plugged-4afa859b-b4dd-4a45-aace-f4ad471db0d6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:27:05 user nova-compute[71692]: WARNING nova.compute.manager [req-5b3c082b-bbfc-4461-9c6f-faed4406beff req-e9d9cd8f-4ff4-4b6e-95ad-df2b87e7be86 service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Received unexpected event network-vif-plugged-4afa859b-b4dd-4a45-aace-f4ad471db0d6 for instance with vm_state building and task_state spawning.
Apr 13 19:27:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:07 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414027.113942, 9ef84353-ff2d-4835-b160-e801179c0c9c => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:27:07 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] VM Resumed (Lifecycle Event)
Apr 13 19:27:07 user nova-compute[71692]: DEBUG nova.compute.manager [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:27:07 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:27:07 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Instance spawned successfully.
Apr 13 19:27:07 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:27:07 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:27:07 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:27:07 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:27:07 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:27:07 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:27:07 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414027.116666, 9ef84353-ff2d-4835-b160-e801179c0c9c => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:27:07 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] VM Started (Lifecycle Event)
Apr 13 19:27:07 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:27:07 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:27:07 user nova-compute[71692]: INFO nova.compute.manager [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Took 5.00 seconds to spawn the instance on the hypervisor.
Apr 13 19:27:07 user nova-compute[71692]: DEBUG nova.compute.manager [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:27:07 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:27:07 user nova-compute[71692]: INFO nova.compute.manager [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Took 16.32 seconds to build instance.
Apr 13 19:27:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1d5a449f-0d47-4f98-99cd-cb07338cfbca tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "9ef84353-ff2d-4835-b160-e801179c0c9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.445s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:27:07 user nova-compute[71692]: DEBUG nova.compute.manager [req-7f9c589b-6aa6-41c9-af5a-75cbad49b4b1 req-e4b94b8b-24cc-4929-abc5-67e63aa3c083 service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Received event network-vif-plugged-4afa859b-b4dd-4a45-aace-f4ad471db0d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:27:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7f9c589b-6aa6-41c9-af5a-75cbad49b4b1 req-e4b94b8b-24cc-4929-abc5-67e63aa3c083 service nova] Acquiring lock "9ef84353-ff2d-4835-b160-e801179c0c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:27:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7f9c589b-6aa6-41c9-af5a-75cbad49b4b1 req-e4b94b8b-24cc-4929-abc5-67e63aa3c083 service nova] Lock "9ef84353-ff2d-4835-b160-e801179c0c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:27:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7f9c589b-6aa6-41c9-af5a-75cbad49b4b1 req-e4b94b8b-24cc-4929-abc5-67e63aa3c083 service nova] Lock "9ef84353-ff2d-4835-b160-e801179c0c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:27:07 user nova-compute[71692]: DEBUG nova.compute.manager [req-7f9c589b-6aa6-41c9-af5a-75cbad49b4b1 req-e4b94b8b-24cc-4929-abc5-67e63aa3c083 service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] No waiting events found dispatching network-vif-plugged-4afa859b-b4dd-4a45-aace-f4ad471db0d6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:27:07 user nova-compute[71692]: WARNING nova.compute.manager [req-7f9c589b-6aa6-41c9-af5a-75cbad49b4b1 req-e4b94b8b-24cc-4929-abc5-67e63aa3c083 service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Received unexpected event network-vif-plugged-4afa859b-b4dd-4a45-aace-f4ad471db0d6 for instance with vm_state active and task_state None.
Apr 13 19:27:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:27:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:27:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:27:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:27:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:51 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:27:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:53 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:27:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:27:54 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:27:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:27:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-4f05f7e3-6b1d-42bb-a567-ebfab8001772" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:27:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-4f05f7e3-6b1d-42bb-a567-ebfab8001772" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:27:54 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:27:54 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Updating instance_info_cache with network_info: [{"id": "d4720014-5ce3-41b2-80e7-02fc430417f3", "address": "fa:16:3e:f0:2e:55", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4720014-5c", "ovs_interfaceid": "d4720014-5ce3-41b2-80e7-02fc430417f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:27:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-4f05f7e3-6b1d-42bb-a567-ebfab8001772" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:27:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:27:54 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:27:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:27:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:27:58 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:27:58 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:27:58 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8370MB free_disk=25.939434051513672GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 9ef84353-ff2d-4835-b160-e801179c0c9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing inventories for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating ProviderTree inventory for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating inventory in ProviderTree for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing aggregate associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, aggregates: None {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 19:27:58 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing trait associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 19:27:59 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:27:59 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:27:59 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:27:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.587s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:27:59 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:28:00 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:28:00 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:28:00 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:28:03 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:28:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:04 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:28:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 19:28:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] There are 0 instances to clean {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 19:28:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:28:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:19 user nova-compute[71692]: INFO nova.compute.manager [None req-7b958603-b64c-44fe-a382-c200c33db178 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Unrescuing
Apr 13 19:28:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7b958603-b64c-44fe-a382-c200c33db178 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:28:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7b958603-b64c-44fe-a382-c200c33db178 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquired lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:28:19 user nova-compute[71692]: DEBUG nova.network.neutron [None req-7b958603-b64c-44fe-a382-c200c33db178 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:28:19 user nova-compute[71692]: DEBUG nova.network.neutron [None req-7b958603-b64c-44fe-a382-c200c33db178 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Updating instance_info_cache with network_info: [{"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:28:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-7b958603-b64c-44fe-a382-c200c33db178 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Releasing lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:28:19 user nova-compute[71692]: DEBUG nova.objects.instance [None req-7b958603-b64c-44fe-a382-c200c33db178 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'flavor' on Instance uuid 991871a0-3a4e-4014-b07f-3e8c49eeda5a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:28:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:19 user nova-compute[71692]: DEBUG nova.compute.manager [req-982af315-6b18-45b9-95fd-65612044cd7d req-7b203fa0-8d07-4873-a01f-7be994bb74a0 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received event network-vif-unplugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:28:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-982af315-6b18-45b9-95fd-65612044cd7d req-7b203fa0-8d07-4873-a01f-7be994bb74a0 service nova] Acquiring lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:28:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-982af315-6b18-45b9-95fd-65612044cd7d req-7b203fa0-8d07-4873-a01f-7be994bb74a0 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:28:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-982af315-6b18-45b9-95fd-65612044cd7d req-7b203fa0-8d07-4873-a01f-7be994bb74a0 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:28:19 user nova-compute[71692]: DEBUG nova.compute.manager [req-982af315-6b18-45b9-95fd-65612044cd7d req-7b203fa0-8d07-4873-a01f-7be994bb74a0 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] No waiting events found dispatching network-vif-unplugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:28:19 user nova-compute[71692]: WARNING nova.compute.manager [req-982af315-6b18-45b9-95fd-65612044cd7d req-7b203fa0-8d07-4873-a01f-7be994bb74a0 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received unexpected event network-vif-unplugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance with vm_state rescued and task_state unrescuing.
Apr 13 19:28:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:20 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Instance destroyed successfully.
Apr 13 19:28:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:21 user nova-compute[71692]: DEBUG nova.compute.manager [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:28:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] Acquiring lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:28:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:28:21 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:28:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] No waiting events found dispatching network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:28:22 user nova-compute[71692]: WARNING nova.compute.manager [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received unexpected event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance with vm_state rescued and task_state unrescuing.
Apr 13 19:28:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:28:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] Acquiring lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:28:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:28:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:28:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] No waiting events found dispatching network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:28:22 user nova-compute[71692]: WARNING nova.compute.manager [req-e93c2dac-8158-4933-b039-30382b61539c req-038a9e0d-5d45-41e8-bd2a-4c6478f0a0b5 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received unexpected event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance with vm_state rescued and task_state unrescuing.
Apr 13 19:28:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:23 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Removed pending event for 991871a0-3a4e-4014-b07f-3e8c49eeda5a due to event {{(pid=71692) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 19:28:23 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414103.7429616, 991871a0-3a4e-4014-b07f-3e8c49eeda5a => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:28:23 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] VM Resumed (Lifecycle Event)
Apr 13 19:28:23 user nova-compute[71692]: DEBUG nova.compute.manager [None req-7b958603-b64c-44fe-a382-c200c33db178 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:28:23 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:28:23 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:28:23 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 19:28:23 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414103.743931, 991871a0-3a4e-4014-b07f-3e8c49eeda5a => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:28:23 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] VM Started (Lifecycle Event)
Apr 13 19:28:23 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:28:23 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:28:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-d6789246-2933-4963-b2fd-7e99a2550585 req-a115bd1a-c1c3-49f3-954b-00a414d29ae4 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:28:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d6789246-2933-4963-b2fd-7e99a2550585 req-a115bd1a-c1c3-49f3-954b-00a414d29ae4 service nova] Acquiring lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:28:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d6789246-2933-4963-b2fd-7e99a2550585 req-a115bd1a-c1c3-49f3-954b-00a414d29ae4 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:28:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d6789246-2933-4963-b2fd-7e99a2550585 req-a115bd1a-c1c3-49f3-954b-00a414d29ae4 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:28:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-d6789246-2933-4963-b2fd-7e99a2550585 req-a115bd1a-c1c3-49f3-954b-00a414d29ae4 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] No waiting events found dispatching network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:28:24 user nova-compute[71692]: WARNING nova.compute.manager [req-d6789246-2933-4963-b2fd-7e99a2550585 req-a115bd1a-c1c3-49f3-954b-00a414d29ae4 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received unexpected event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance with vm_state active and task_state None.
Apr 13 19:28:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "9ef84353-ff2d-4835-b160-e801179c0c9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:28:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "9ef84353-ff2d-4835-b160-e801179c0c9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:28:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "9ef84353-ff2d-4835-b160-e801179c0c9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:28:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "9ef84353-ff2d-4835-b160-e801179c0c9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:28:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "9ef84353-ff2d-4835-b160-e801179c0c9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:28:41 user nova-compute[71692]: INFO nova.compute.manager [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Terminating instance
Apr 13 19:28:41 user nova-compute[71692]: DEBUG nova.compute.manager [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:28:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-9c473a6d-9019-4331-8dc6-be7288791892 req-e814cf00-78d4-4770-8534-24432b3b3aa5 service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Received event network-vif-unplugged-4afa859b-b4dd-4a45-aace-f4ad471db0d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:28:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9c473a6d-9019-4331-8dc6-be7288791892 req-e814cf00-78d4-4770-8534-24432b3b3aa5 service nova] Acquiring lock "9ef84353-ff2d-4835-b160-e801179c0c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:28:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9c473a6d-9019-4331-8dc6-be7288791892 req-e814cf00-78d4-4770-8534-24432b3b3aa5 service nova] Lock "9ef84353-ff2d-4835-b160-e801179c0c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:28:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9c473a6d-9019-4331-8dc6-be7288791892 req-e814cf00-78d4-4770-8534-24432b3b3aa5 service nova] Lock "9ef84353-ff2d-4835-b160-e801179c0c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:28:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-9c473a6d-9019-4331-8dc6-be7288791892 req-e814cf00-78d4-4770-8534-24432b3b3aa5 service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] No waiting events found dispatching network-vif-unplugged-4afa859b-b4dd-4a45-aace-f4ad471db0d6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:28:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-9c473a6d-9019-4331-8dc6-be7288791892 req-e814cf00-78d4-4770-8534-24432b3b3aa5 service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Received event network-vif-unplugged-4afa859b-b4dd-4a45-aace-f4ad471db0d6 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:28:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:42 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Instance destroyed successfully.
Apr 13 19:28:42 user nova-compute[71692]: DEBUG nova.objects.instance [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lazy-loading 'resources' on Instance uuid 9ef84353-ff2d-4835-b160-e801179c0c9c {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:26:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-524715520',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-524715520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-524715520',id=40,image_ref='a6c0ca1e-e429-492c-9775-cc28706bb32b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:27:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-kkr1mndu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1717000141',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:27:07Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=9ef84353-ff2d-4835-b160-e801179c0c9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "address": "fa:16:3e:c0:b0:14", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afa859b-b4", "ovs_interfaceid": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "address": "fa:16:3e:c0:b0:14", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4afa859b-b4", "ovs_interfaceid": "4afa859b-b4dd-4a45-aace-f4ad471db0d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b0:14,bridge_name='br-int',has_traffic_filtering=True,id=4afa859b-b4dd-4a45-aace-f4ad471db0d6,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4afa859b-b4') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_vif [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b0:14,bridge_name='br-int',has_traffic_filtering=True,id=4afa859b-b4dd-4a45-aace-f4ad471db0d6,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4afa859b-b4') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4afa859b-b4, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:28:42 user nova-compute[71692]: INFO os_vif [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:b0:14,bridge_name='br-int',has_traffic_filtering=True,id=4afa859b-b4dd-4a45-aace-f4ad471db0d6,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4afa859b-b4')
Apr 13 19:28:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXwGOnHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:28:42 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa54bc5-1d1a-4ecd-b81e-60244e2694f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:28:42 user nova-compute[71692]: No targets found.
Apr 13 19:28:42 user nova-compute[71692]: iSNS:
Apr 13 19:28:42 user nova-compute[71692]: No targets found.
Apr 13 19:28:42 user nova-compute[71692]: STATIC:
Apr 13 19:28:42 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5
Apr 13 19:28:42 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:28:42 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:28:42 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5
Apr 13 19:28:42 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:28:42 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:28:42 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945
Apr 13 19:28:42 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:28:42 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:28:42 user nova-compute[71692]: FIRMWARE:
Apr 13 19:28:42 user nova-compute[71692]: No targets found.
Apr 13 19:28:42 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:28:42 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:28:42 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b8b049-b5c1-456e-a002-7ff67b3dbdc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[27853514-e9f7-4e76-ae35-052156a1efcf]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:28:42 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:28:42 user nova-compute[71692]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 (non-flash)
Apr 13 19:28:42 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:28:42 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:28:42 user nova-compute[71692]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 (non-flash)
Apr 13 19:28:42 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feba052a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5'): ({'sdd'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Removing single pathed devices sdd {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2d8407-7e02-40ab-b428-beffb3cb704a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cd19a2-7af1-43c9-bef7-2d57606b6a4a]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flushing IO for device /dev/sdd {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[90da6a22-4f4b-4606-859f-ad807d154fe9]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[327ee99d-c7cc-4dd5-9f39-f1e175f272b1]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23338336438333136', '/dev/disk/by-id/scsi-1SCST_BIOc2700de1-383d8316ab466b29', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c2700de1') {{(pid=82243) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d05ac71-be42-4e50-8823-a2f5d8f83a36]: (4, None) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[031189e7-8a49-41d1-bb37-081f5009a52f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'flavor' on Instance uuid 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf96942-3a50-409c-b049-0fa4d78a0f3e]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5, portal: 172.16.0.220,3260]
Apr 13 19:28:42 user nova-compute[71692]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5, portal: 172.16.0.220,3260] successful.
Apr 13 19:28:42 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cc14048-5307-4fd4-8677-339648022ed5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab4089b-e23c-4277-b7d6-c906a4984313]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== disconnect_volume: return (310ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:28:42 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Deleting instance files /opt/stack/data/nova/instances/9ef84353-ff2d-4835-b160-e801179c0c9c_del
Apr 13 19:28:42 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Deletion of /opt/stack/data/nova/instances/9ef84353-ff2d-4835-b160-e801179c0c9c_del complete
Apr 13 19:28:42 user nova-compute[71692]: INFO nova.compute.manager [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:28:42 user nova-compute[71692]: INFO nova.compute.manager [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Attaching volume ec99b355-2456-4eef-af04-cc75aff66777 to /dev/vdb
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.utils [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fc9f73-ee09-41c3-a120-51c85a6e9041]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b058999-54c0-4096-9a27-dea5fbfabefe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a52bd9d-bb24-4849-8cad-3f65e4a36e90]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c334e348-7083-48a0-8fea-3a533e8c0324]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:28:42 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:28:42 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f207636d-bcb7-48cf-9003-588b035a8381]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG os_brick.utils [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Updating existing volume attachment record: 7e2f6e24-71ee-4847-b1fd-5d5d8382d01c {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:28:42 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:28:43 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Took 0.58 seconds to deallocate network for instance.
Apr 13 19:28:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-402c7823-f988-4769-a4cb-59b26abeff86 req-c06718a1-ff3b-4e7b-8b1e-ea0b8e6464ee service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Received event network-vif-deleted-4afa859b-b4dd-4a45-aace-f4ad471db0d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:28:43 user nova-compute[71692]: INFO nova.compute.manager [req-402c7823-f988-4769-a4cb-59b26abeff86 req-c06718a1-ff3b-4e7b-8b1e-ea0b8e6464ee service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Neutron deleted interface 4afa859b-b4dd-4a45-aace-f4ad471db0d6; detaching it from the instance and deleting it from the info cache
Apr 13 19:28:43 user nova-compute[71692]: DEBUG nova.network.neutron [req-402c7823-f988-4769-a4cb-59b26abeff86 req-c06718a1-ff3b-4e7b-8b1e-ea0b8e6464ee service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:28:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-402c7823-f988-4769-a4cb-59b26abeff86 req-c06718a1-ff3b-4e7b-8b1e-ea0b8e6464ee service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Detach interface failed, port_id=4afa859b-b4dd-4a45-aace-f4ad471db0d6, reason: Instance 9ef84353-ff2d-4835-b160-e801179c0c9c could not be found. {{(pid=71692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 19:28:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-a26db9cc-e1f9-4ccc-8e50-64fc026c990a req-1e2fba32-976f-441c-b328-7c31b82262a1 service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Received event network-vif-plugged-4afa859b-b4dd-4a45-aace-f4ad471db0d6 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:28:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a26db9cc-e1f9-4ccc-8e50-64fc026c990a req-1e2fba32-976f-441c-b328-7c31b82262a1 service nova] Acquiring lock "9ef84353-ff2d-4835-b160-e801179c0c9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:28:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a26db9cc-e1f9-4ccc-8e50-64fc026c990a req-1e2fba32-976f-441c-b328-7c31b82262a1 service nova] Lock "9ef84353-ff2d-4835-b160-e801179c0c9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:28:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a26db9cc-e1f9-4ccc-8e50-64fc026c990a req-1e2fba32-976f-441c-b328-7c31b82262a1 service nova] Lock "9ef84353-ff2d-4835-b160-e801179c0c9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:28:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-a26db9cc-e1f9-4ccc-8e50-64fc026c990a req-1e2fba32-976f-441c-b328-7c31b82262a1 service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] No waiting events found dispatching network-vif-plugged-4afa859b-b4dd-4a45-aace-f4ad471db0d6 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:28:43 user nova-compute[71692]: WARNING nova.compute.manager [req-a26db9cc-e1f9-4ccc-8e50-64fc026c990a req-1e2fba32-976f-441c-b328-7c31b82262a1 service nova] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Received unexpected event network-vif-plugged-4afa859b-b4dd-4a45-aace-f4ad471db0d6 for instance with vm_state active and task_state deleting.
Apr 13 19:28:43 user nova-compute[71692]: INFO nova.compute.manager [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Took 0.80 seconds to detach 1 volumes for instance.
Apr 13 19:28:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Deleting volume: 2cc14048-5307-4fd4-8677-339648022ed5 {{(pid=71692) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 19:28:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:28:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:28:44 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:28:44 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:28:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:28:44 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Deleted allocations for instance 9ef84353-ff2d-4835-b160-e801179c0c9c
Apr 13 19:28:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-40324210-b53e-40ee-bdbf-2b7e226f3996 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "9ef84353-ff2d-4835-b160-e801179c0c9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.022s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:28:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdCcTNKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:28:48 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:28:48 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:28:48 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb738e0-24e3-431b-a372-335c75e47dfe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:28:48 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcef3e08-b336-43fc-856d-e78bcd36413f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777] added
Apr 13 19:28:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b622546-6ffd-4e6d-ab38-42a633d785b3]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e116f260-8802-4160-befd-b0c5a55b3414]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdCcTNKa {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdCcTNKa" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff27c7b7-fa51-469e-b7b5-e7b4ddbcf2c7]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FdCcTNKa'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05c375b-caa7-46a9-b8f9-2768926ade4e]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a18133-3d8d-45f6-8b22-5e468d78a3ad]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:28:48 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:28:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:28:48 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:28:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[55026037-b865-43ac-ac31-ab54c3359ff4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777, portal: 172.16.0.220,3260]
Apr 13 19:28:48 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777, portal: 172.16.0.220,3260] successful.
Apr 13 19:28:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d331b61-54ec-46db-a83d-bbf56147034f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baafc89-c3b6-42cf-8352-6c9a573231b4]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:28:48 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:28:48 user nova-compute[71692]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)
Apr 13 19:28:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:28:48 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:28:48 user nova-compute[71692]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)
Apr 13 19:28:48 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03c62cb-3d60-48bb-9cc6-b6029c24eb98]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:28:48 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:28:49 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:28:49 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdCcTNKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:28:49 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:28:49 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23938326438656132', 'path': '/dev/sdd'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:28:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938326438656132', 'path': '/dev/sdd'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:28:49 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'flavor' on Instance uuid 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:28:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:28:49 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:28:49 user nova-compute[71692]:   <source dev="/dev/sdd"/>
Apr 13 19:28:49 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:28:49 user nova-compute[71692]:   <serial>ec99b355-2456-4eef-af04-cc75aff66777</serial>
Apr 13 19:28:49 user nova-compute[71692]: </disk>
Apr 13 19:28:49 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:28:50 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:28:50 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:28:50 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] No VIF found with MAC fa:16:3e:7b:d7:6a, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:28:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e53dfeb2-d537-42f5-b48e-eebc1e899447 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.056s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:28:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:28:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:28:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:28:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:28:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:52 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:28:54 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:28:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:28:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 19:28:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:28:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:28:54 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:28:54 user nova-compute[71692]: DEBUG nova.objects.instance [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lazy-loading 'info_cache' on Instance uuid 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:28:54 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updating instance_info_cache with network_info: [{"id": "5bd81344-f669-49c6-897f-97510d86e77b", "address": "fa:16:3e:01:0c:f9", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd81344-f6", "ovs_interfaceid": "5bd81344-f669-49c6-897f-97510d86e77b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:28:54 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:28:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:28:55 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:28:55 user nova-compute[71692]: DEBUG nova.compute.manager [req-49aa7c5b-f261-456a-8d64-1ae6806b8420 req-9f727b72-b0e9-4461-9fde-0f74c5855d74 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received event network-changed-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:28:55 user nova-compute[71692]: DEBUG nova.compute.manager [req-49aa7c5b-f261-456a-8d64-1ae6806b8420 req-9f727b72-b0e9-4461-9fde-0f74c5855d74 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Refreshing instance network info cache due to event network-changed-18d17551-39ea-401c-95cf-acfdafb210d5. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:28:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-49aa7c5b-f261-456a-8d64-1ae6806b8420 req-9f727b72-b0e9-4461-9fde-0f74c5855d74 service nova] Acquiring lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:28:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-49aa7c5b-f261-456a-8d64-1ae6806b8420 req-9f727b72-b0e9-4461-9fde-0f74c5855d74 service nova] Acquired lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:28:55 user nova-compute[71692]: DEBUG nova.network.neutron [req-49aa7c5b-f261-456a-8d64-1ae6806b8420 req-9f727b72-b0e9-4461-9fde-0f74c5855d74 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Refreshing network info cache for port 18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:28:55 user nova-compute[71692]: DEBUG nova.network.neutron [req-49aa7c5b-f261-456a-8d64-1ae6806b8420 req-9f727b72-b0e9-4461-9fde-0f74c5855d74 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Updated VIF entry in instance network info cache for port 18d17551-39ea-401c-95cf-acfdafb210d5. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:28:55 user nova-compute[71692]: DEBUG nova.network.neutron [req-49aa7c5b-f261-456a-8d64-1ae6806b8420 req-9f727b72-b0e9-4461-9fde-0f74c5855d74 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Updating instance_info_cache with network_info: [{"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:28:55 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-49aa7c5b-f261-456a-8d64-1ae6806b8420 req-9f727b72-b0e9-4461-9fde-0f74c5855d74 service nova] Releasing lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:28:56 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:28:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-626ef889-f44c-4b09-bb85-5d8bf6df828f req-0d2aa7c6-9eeb-4864-a4c8-fb6da1ed7e0e service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received event network-changed-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:28:56 user nova-compute[71692]: DEBUG nova.compute.manager [req-626ef889-f44c-4b09-bb85-5d8bf6df828f req-0d2aa7c6-9eeb-4864-a4c8-fb6da1ed7e0e service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Refreshing instance network info cache due to event network-changed-18d17551-39ea-401c-95cf-acfdafb210d5. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:28:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-626ef889-f44c-4b09-bb85-5d8bf6df828f req-0d2aa7c6-9eeb-4864-a4c8-fb6da1ed7e0e service nova] Acquiring lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:28:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-626ef889-f44c-4b09-bb85-5d8bf6df828f req-0d2aa7c6-9eeb-4864-a4c8-fb6da1ed7e0e service nova] Acquired lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:28:56 user nova-compute[71692]: DEBUG nova.network.neutron [req-626ef889-f44c-4b09-bb85-5d8bf6df828f req-0d2aa7c6-9eeb-4864-a4c8-fb6da1ed7e0e service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Refreshing network info cache for port 18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:28:56 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681414121.9979064, 9ef84353-ff2d-4835-b160-e801179c0c9c => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:28:57 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] VM Stopped (Lifecycle Event)
Apr 13 19:28:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-2fafdb22-3736-4dbe-887a-51c60635e9be None None] [instance: 9ef84353-ff2d-4835-b160-e801179c0c9c] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG nova.network.neutron [req-626ef889-f44c-4b09-bb85-5d8bf6df828f req-0d2aa7c6-9eeb-4864-a4c8-fb6da1ed7e0e service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Updated VIF entry in instance network info cache for port 18d17551-39ea-401c-95cf-acfdafb210d5. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG nova.network.neutron [req-626ef889-f44c-4b09-bb85-5d8bf6df828f req-0d2aa7c6-9eeb-4864-a4c8-fb6da1ed7e0e service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Updating instance_info_cache with network_info: [{"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-626ef889-f44c-4b09-bb85-5d8bf6df828f req-0d2aa7c6-9eeb-4864-a4c8-fb6da1ed7e0e service nova] Releasing lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:28:57 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:28:58 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:28:58 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:28:58 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8536MB free_disk=25.930503845214844GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:28:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:28:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:28:58 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:28:58 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:28:58 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:28:58 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:28:58 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:28:58 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:28:58 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:28:58 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:28:58 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:28:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:28:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:28:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:28:59 user nova-compute[71692]: INFO nova.compute.manager [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Rebooting instance
Apr 13 19:28:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:28:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquired lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:28:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:28:59 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:28:59 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:28:59 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:28:59 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:28:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:28:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Updating instance_info_cache with network_info: [{"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:28:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Releasing lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:28:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-2d2e2749-01b2-457d-819a-ad61e051eac5 req-91ef7b80-697d-4276-bc89-77a3cdaa6433 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received event network-vif-unplugged-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2d2e2749-01b2-457d-819a-ad61e051eac5 req-91ef7b80-697d-4276-bc89-77a3cdaa6433 service nova] Acquiring lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2d2e2749-01b2-457d-819a-ad61e051eac5 req-91ef7b80-697d-4276-bc89-77a3cdaa6433 service nova] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-2d2e2749-01b2-457d-819a-ad61e051eac5 req-91ef7b80-697d-4276-bc89-77a3cdaa6433 service nova] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-2d2e2749-01b2-457d-819a-ad61e051eac5 req-91ef7b80-697d-4276-bc89-77a3cdaa6433 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] No waiting events found dispatching network-vif-unplugged-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:29:00 user nova-compute[71692]: WARNING nova.compute.manager [req-2d2e2749-01b2-457d-819a-ad61e051eac5 req-91ef7b80-697d-4276-bc89-77a3cdaa6433 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received unexpected event network-vif-unplugged-18d17551-39ea-401c-95cf-acfdafb210d5 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 19:29:00 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Instance destroyed successfully.
Apr 13 19:29:00 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'resources' on Instance uuid 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-304929672',display_name='tempest-TestMinimumBasicScenario-server-304929672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-304929672',id=39,image_ref='dc0ead7b-fade-4a75-ad11-302ad2eb923b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjiNQrMZkLrv/EsYiTKx9Bso1DHqJYptOtxcSQw4ewhiYzdhDtT3eKqKNXIIMToEcZ9WUG6UoWwxRLW6EfnAJANQV8bUtuFoVgIl7T4cD+d2MiwUmR5kNz16P2NI+rGLA==',key_name='tempest-TestMinimumBasicScenario-256533708',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:26:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba0e42217cc44413951d6d5a87dbb886',ramdisk_id='',reservation_id='r-lcu3iow5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dc0ead7b-fade-4a75-ad11-302ad2eb923b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-8202894',owner_user_name='tempest-TestMinimumBasicScenario-8202894-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:29:00Z,user_data=None,user_id='9b9ed2da2b4949269c2df77766a1835f',uuid=595c2a08-28fd-4076-b7bb-b9b0ac4349e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converting VIF {"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:d7:6a,bridge_name='br-int',has_traffic_filtering=True,id=18d17551-39ea-401c-95cf-acfdafb210d5,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d17551-39') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG os_vif [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:d7:6a,bridge_name='br-int',has_traffic_filtering=True,id=18d17551-39ea-401c-95cf-acfdafb210d5,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d17551-39') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18d17551-39, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:29:00 user nova-compute[71692]: INFO os_vif [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:d7:6a,bridge_name='br-int',has_traffic_filtering=True,id=18d17551-39ea-401c-95cf-acfdafb210d5,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d17551-39')
Apr 13 19:29:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdCcTNKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:29:00 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:29:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2883aaf4-50af-49da-8a96-99e9e85df375]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:29:00 user nova-compute[71692]: No targets found.
Apr 13 19:29:00 user nova-compute[71692]: iSNS:
Apr 13 19:29:00 user nova-compute[71692]: No targets found.
Apr 13 19:29:00 user nova-compute[71692]: STATIC:
Apr 13 19:29:00 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777
Apr 13 19:29:00 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:29:00 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:29:00 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5
Apr 13 19:29:00 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:29:00 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:29:00 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945
Apr 13 19:29:00 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:29:00 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:29:00 user nova-compute[71692]: FIRMWARE:
Apr 13 19:29:00 user nova-compute[71692]: No targets found.
Apr 13 19:29:00 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:29:00 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:29:00 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd651fa1-7559-4258-aef8-bf7ef0cff644]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cd802b-46cb-4b3e-890a-64fce514c15a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:29:00 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:29:00 user nova-compute[71692]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)
Apr 13 19:29:00 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:29:00 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:29:00 user nova-compute[71692]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)
Apr 13 19:29:00 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feba0538a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777'): ({'sdd'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Removing single pathed devices sdd {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbf4041-bd21-445e-9973-1ad373a20030]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a17f4ba-b6dc-4582-bad0-00a3df6d58b8]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Flushing IO for device /dev/sdd {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cbe0d1-4282-467b-9157-a423ff4be5c5]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:29:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7595689b-4c28-4596-a56d-dbc1a65a4c44]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bde9140-35c7-4a0d-9b18-6bc0076865bf]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca1bf58-c2dd-4126-97a6-2ee10a480dde]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777, portal: 172.16.0.220,3260]
Apr 13 19:29:01 user nova-compute[71692]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777, portal: 172.16.0.220,3260] successful.
Apr 13 19:29:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7289a42e-6333-4644-9b3d-a4f75c393d8b]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] <== disconnect_volume: return (313ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Start _get_guest_xml network_info=[{"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dc0ead7b-fade-4a75-ad11-302ad2eb923b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'dc0ead7b-fade-4a75-ad11-302ad2eb923b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'attachment_id': '7e2f6e24-71ee-4847-b1fd-5d5d8382d01c', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdCcTNKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '595c2a08-28fd-4076-b7bb-b9b0ac4349e6', 'attached_at': '', 'detached_at': '', 'volume_id': 'ec99b355-2456-4eef-af04-cc75aff66777', 'serial': 'ec99b355-2456-4eef-af04-cc75aff66777'}, 'mount_device': '/dev/vdb', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:29:01 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:29:01 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:29:01 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dc0ead7b-fade-4a75-ad11-302ad2eb923b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'vcpu_model' on Instance uuid 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdCcTNKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:29:01 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:29:01 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:29:01 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c98c25-5a73-4c36-8f12-7153678ffd0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:29:01 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1695a8ea-5872-4b91-9db0-e2aad86493aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777] added
Apr 13 19:29:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[54159438-72ad-4713-a8fe-190eb9cac923]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[64508a57-81b6-475d-b680-fddf131c1a55]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdCcTNKa {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdCcTNKa" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[401594b1-f9bd-44d4-8167-6428849979df]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FdCcTNKa'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d1521c-9bf9-4749-a1e7-15ba280eaa04]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[65757fdb-e689-4e66-8f1e-b85bef140df1]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:29:01 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:29:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:29:01 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:29:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30452c0-5ffa-4ab2-ae2a-5edf5adca41c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777, portal: 172.16.0.220,3260]
Apr 13 19:29:01 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777, portal: 172.16.0.220,3260] successful.
Apr 13 19:29:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[566d8605-7d9c-4bdd-8ac9-55f8f0f8d633]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c06f04-d7f4-4c91-a63e-6b0697169bde]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:29:01 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:29:01 user nova-compute[71692]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)
Apr 13 19:29:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:29:01 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:29:01 user nova-compute[71692]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)
Apr 13 19:29:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e111a5d3-bea8-44cc-91f3-abde1fe9788e]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:01 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG nova.compute.manager [req-09532e46-572b-4fe6-b19a-b44b56cda1df req-ce810fb7-8697-43fb-9823-5275b53ea529 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received event network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-09532e46-572b-4fe6-b19a-b44b56cda1df req-ce810fb7-8697-43fb-9823-5275b53ea529 service nova] Acquiring lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-09532e46-572b-4fe6-b19a-b44b56cda1df req-ce810fb7-8697-43fb-9823-5275b53ea529 service nova] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-09532e46-572b-4fe6-b19a-b44b56cda1df req-ce810fb7-8697-43fb-9823-5275b53ea529 service nova] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG nova.compute.manager [req-09532e46-572b-4fe6-b19a-b44b56cda1df req-ce810fb7-8697-43fb-9823-5275b53ea529 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] No waiting events found dispatching network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:29:02 user nova-compute[71692]: WARNING nova.compute.manager [req-09532e46-572b-4fe6-b19a-b44b56cda1df req-ce810fb7-8697-43fb-9823-5275b53ea529 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received unexpected event network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 19:29:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdCcTNKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23938326438656132', 'path': '/dev/sdd'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938326438656132', 'path': '/dev/sdd'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-304929672',display_name='tempest-TestMinimumBasicScenario-server-304929672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-304929672',id=39,image_ref='dc0ead7b-fade-4a75-ad11-302ad2eb923b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjiNQrMZkLrv/EsYiTKx9Bso1DHqJYptOtxcSQw4ewhiYzdhDtT3eKqKNXIIMToEcZ9WUG6UoWwxRLW6EfnAJANQV8bUtuFoVgIl7T4cD+d2MiwUmR5kNz16P2NI+rGLA==',key_name='tempest-TestMinimumBasicScenario-256533708',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:26:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba0e42217cc44413951d6d5a87dbb886',ramdisk_id='',reservation_id='r-lcu3iow5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dc0ead7b-fade-4a75-ad11-302ad2eb923b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-8202894',owner_user_name='tempest-TestMinimumBasicScenario-8202894-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:29:00Z,user_data=None,user_id='9b9ed2da2b4949269c2df77766a1835f',uuid=595c2a08-28fd-4076-b7bb-b9b0ac4349e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converting VIF {"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:d7:6a,bridge_name='br-int',has_traffic_filtering=True,id=18d17551-39ea-401c-95cf-acfdafb210d5,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d17551-39') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'pci_devices' on Instance uuid 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:29:02 user nova-compute[71692]:   <uuid>595c2a08-28fd-4076-b7bb-b9b0ac4349e6</uuid>
Apr 13 19:29:02 user nova-compute[71692]:   <name>instance-00000027</name>
Apr 13 19:29:02 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:29:02 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:29:02 user nova-compute[71692]:   <metadata>
Apr 13 19:29:02 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:29:02 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:29:02 user nova-compute[71692]:       <nova:name>tempest-TestMinimumBasicScenario-server-304929672</nova:name>
Apr 13 19:29:02 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:29:01</nova:creationTime>
Apr 13 19:29:02 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:29:02 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:29:02 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:29:02 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:29:02 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:29:02 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:29:02 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:29:02 user nova-compute[71692]:       <nova:owner>
Apr 13 19:29:02 user nova-compute[71692]:         <nova:user uuid="9b9ed2da2b4949269c2df77766a1835f">tempest-TestMinimumBasicScenario-8202894-project-member</nova:user>
Apr 13 19:29:02 user nova-compute[71692]:         <nova:project uuid="ba0e42217cc44413951d6d5a87dbb886">tempest-TestMinimumBasicScenario-8202894</nova:project>
Apr 13 19:29:02 user nova-compute[71692]:       </nova:owner>
Apr 13 19:29:02 user nova-compute[71692]:       <nova:root type="image" uuid="dc0ead7b-fade-4a75-ad11-302ad2eb923b"/>
Apr 13 19:29:02 user nova-compute[71692]:       <nova:ports>
Apr 13 19:29:02 user nova-compute[71692]:         <nova:port uuid="18d17551-39ea-401c-95cf-acfdafb210d5">
Apr 13 19:29:02 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 19:29:02 user nova-compute[71692]:         </nova:port>
Apr 13 19:29:02 user nova-compute[71692]:       </nova:ports>
Apr 13 19:29:02 user nova-compute[71692]:     </nova:instance>
Apr 13 19:29:02 user nova-compute[71692]:   </metadata>
Apr 13 19:29:02 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:29:02 user nova-compute[71692]:     <system>
Apr 13 19:29:02 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:29:02 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:29:02 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:29:02 user nova-compute[71692]:       <entry name="serial">595c2a08-28fd-4076-b7bb-b9b0ac4349e6</entry>
Apr 13 19:29:02 user nova-compute[71692]:       <entry name="uuid">595c2a08-28fd-4076-b7bb-b9b0ac4349e6</entry>
Apr 13 19:29:02 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:29:02 user nova-compute[71692]:     </system>
Apr 13 19:29:02 user nova-compute[71692]:   </sysinfo>
Apr 13 19:29:02 user nova-compute[71692]:   <os>
Apr 13 19:29:02 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:29:02 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:29:02 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:29:02 user nova-compute[71692]:   </os>
Apr 13 19:29:02 user nova-compute[71692]:   <features>
Apr 13 19:29:02 user nova-compute[71692]:     <acpi/>
Apr 13 19:29:02 user nova-compute[71692]:     <apic/>
Apr 13 19:29:02 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:29:02 user nova-compute[71692]:   </features>
Apr 13 19:29:02 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:29:02 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:29:02 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:29:02 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:29:02 user nova-compute[71692]:   </clock>
Apr 13 19:29:02 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:29:02 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:29:02 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:29:02 user nova-compute[71692]:   </cpu>
Apr 13 19:29:02 user nova-compute[71692]:   <devices>
Apr 13 19:29:02 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:29:02 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:29:02 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk"/>
Apr 13 19:29:02 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:29:02 user nova-compute[71692]:     </disk>
Apr 13 19:29:02 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:29:02 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:29:02 user nova-compute[71692]:       <source dev="/dev/sdd"/>
Apr 13 19:29:02 user nova-compute[71692]:       <target dev="vdb" bus="virtio"/>
Apr 13 19:29:02 user nova-compute[71692]:       <serial>ec99b355-2456-4eef-af04-cc75aff66777</serial>
Apr 13 19:29:02 user nova-compute[71692]:     </disk>
Apr 13 19:29:02 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:29:02 user nova-compute[71692]:       <mac address="fa:16:3e:7b:d7:6a"/>
Apr 13 19:29:02 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:29:02 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:29:02 user nova-compute[71692]:       <target dev="tap18d17551-39"/>
Apr 13 19:29:02 user nova-compute[71692]:     </interface>
Apr 13 19:29:02 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:29:02 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/console.log" append="off"/>
Apr 13 19:29:02 user nova-compute[71692]:     </serial>
Apr 13 19:29:02 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:29:02 user nova-compute[71692]:     <video>
Apr 13 19:29:02 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:29:02 user nova-compute[71692]:     </video>
Apr 13 19:29:02 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:29:02 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:29:02 user nova-compute[71692]:     </rng>
Apr 13 19:29:02 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:29:02 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:29:02 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:29:02 user nova-compute[71692]:     </memballoon>
Apr 13 19:29:02 user nova-compute[71692]:   </devices>
Apr 13 19:29:02 user nova-compute[71692]: </domain>
Apr 13 19:29:02 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'trusted_certs' on Instance uuid 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:29:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209 --force-share --output=json" returned: 0 in 0.134s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Checking if we can resize image /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Cannot resize image /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'migration_context' on Instance uuid 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-304929672',display_name='tempest-TestMinimumBasicScenario-server-304929672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-304929672',id=39,image_ref='dc0ead7b-fade-4a75-ad11-302ad2eb923b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjiNQrMZkLrv/EsYiTKx9Bso1DHqJYptOtxcSQw4ewhiYzdhDtT3eKqKNXIIMToEcZ9WUG6UoWwxRLW6EfnAJANQV8bUtuFoVgIl7T4cD+d2MiwUmR5kNz16P2NI+rGLA==',key_name='tempest-TestMinimumBasicScenario-256533708',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:26:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='ba0e42217cc44413951d6d5a87dbb886',ramdisk_id='',reservation_id='r-lcu3iow5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dc0ead7b-fade-4a75-ad11-302ad2eb923b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-8202894',owner_user_name='tempest-TestMinimumBasicScenario-8202894-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:29:00Z,user_data=None,user_id='9b9ed2da2b4949269c2df77766a1835f',uuid=595c2a08-28fd-4076-b7bb-b9b0ac4349e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converting VIF {"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:d7:6a,bridge_name='br-int',has_traffic_filtering=True,id=18d17551-39ea-401c-95cf-acfdafb210d5,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d17551-39') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG os_vif [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:d7:6a,bridge_name='br-int',has_traffic_filtering=True,id=18d17551-39ea-401c-95cf-acfdafb210d5,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d17551-39') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18d17551-39, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18d17551-39, col_values=(('external_ids', {'iface-id': '18d17551-39ea-401c-95cf-acfdafb210d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:d7:6a', 'vm-uuid': '595c2a08-28fd-4076-b7bb-b9b0ac4349e6'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:29:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:03 user nova-compute[71692]: INFO os_vif [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:d7:6a,bridge_name='br-int',has_traffic_filtering=True,id=18d17551-39ea-401c-95cf-acfdafb210d5,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d17551-39')
Apr 13 19:29:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-b624cf1b-1cbc-4762-bf3f-408458212090 req-86dcd436-cb4e-4701-b09a-18f7970596df service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received event network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:29:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b624cf1b-1cbc-4762-bf3f-408458212090 req-86dcd436-cb4e-4701-b09a-18f7970596df service nova] Acquiring lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:29:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b624cf1b-1cbc-4762-bf3f-408458212090 req-86dcd436-cb4e-4701-b09a-18f7970596df service nova] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:29:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b624cf1b-1cbc-4762-bf3f-408458212090 req-86dcd436-cb4e-4701-b09a-18f7970596df service nova] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:29:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-b624cf1b-1cbc-4762-bf3f-408458212090 req-86dcd436-cb4e-4701-b09a-18f7970596df service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] No waiting events found dispatching network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:29:04 user nova-compute[71692]: WARNING nova.compute.manager [req-b624cf1b-1cbc-4762-bf3f-408458212090 req-86dcd436-cb4e-4701-b09a-18f7970596df service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received unexpected event network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 19:29:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Removed pending event for 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 due to event {{(pid=71692) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 19:29:06 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414146.56254, 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:29:06 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] VM Resumed (Lifecycle Event)
Apr 13 19:29:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:29:06 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Instance rebooted successfully.
Apr 13 19:29:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:29:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:29:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:29:06 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 13 19:29:06 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414146.5642304, 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:29:06 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] VM Started (Lifecycle Event)
Apr 13 19:29:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:29:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e4386439-8721-4bf3-a2ea-3bcae4675f10 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.223s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:29:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:29:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-d51f2579-73d2-488e-a5dd-dd3d4b8a5487 req-16cfb550-7ae4-4b63-ba87-1426fb545b12 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received event network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:29:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d51f2579-73d2-488e-a5dd-dd3d4b8a5487 req-16cfb550-7ae4-4b63-ba87-1426fb545b12 service nova] Acquiring lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:29:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d51f2579-73d2-488e-a5dd-dd3d4b8a5487 req-16cfb550-7ae4-4b63-ba87-1426fb545b12 service nova] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:29:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d51f2579-73d2-488e-a5dd-dd3d4b8a5487 req-16cfb550-7ae4-4b63-ba87-1426fb545b12 service nova] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:29:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-d51f2579-73d2-488e-a5dd-dd3d4b8a5487 req-16cfb550-7ae4-4b63-ba87-1426fb545b12 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] No waiting events found dispatching network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:29:06 user nova-compute[71692]: WARNING nova.compute.manager [req-d51f2579-73d2-488e-a5dd-dd3d4b8a5487 req-16cfb550-7ae4-4b63-ba87-1426fb545b12 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received unexpected event network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 for instance with vm_state active and task_state None.
Apr 13 19:29:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:29:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:29:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:29:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:29:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:29:33 user nova-compute[71692]: INFO nova.compute.manager [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Terminating instance
Apr 13 19:29:33 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG nova.compute.manager [req-dda9ca7a-7a21-4205-b9ab-a8f253c98507 req-c06e2db5-fcec-4d75-a95f-6d90529ce7d8 service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Received event network-vif-unplugged-d4720014-5ce3-41b2-80e7-02fc430417f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dda9ca7a-7a21-4205-b9ab-a8f253c98507 req-c06e2db5-fcec-4d75-a95f-6d90529ce7d8 service nova] Acquiring lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dda9ca7a-7a21-4205-b9ab-a8f253c98507 req-c06e2db5-fcec-4d75-a95f-6d90529ce7d8 service nova] Lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dda9ca7a-7a21-4205-b9ab-a8f253c98507 req-c06e2db5-fcec-4d75-a95f-6d90529ce7d8 service nova] Lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG nova.compute.manager [req-dda9ca7a-7a21-4205-b9ab-a8f253c98507 req-c06e2db5-fcec-4d75-a95f-6d90529ce7d8 service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] No waiting events found dispatching network-vif-unplugged-d4720014-5ce3-41b2-80e7-02fc430417f3 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG nova.compute.manager [req-dda9ca7a-7a21-4205-b9ab-a8f253c98507 req-c06e2db5-fcec-4d75-a95f-6d90529ce7d8 service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Received event network-vif-unplugged-d4720014-5ce3-41b2-80e7-02fc430417f3 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:29:34 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Instance destroyed successfully.
Apr 13 19:29:34 user nova-compute[71692]: DEBUG nova.objects.instance [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lazy-loading 'resources' on Instance uuid 4f05f7e3-6b1d-42bb-a567-ebfab8001772 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:24:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-241646845',display_name='tempest-TestVolumeBootPattern-volume-backed-server-241646845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-241646845',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:25:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-elgmxrk7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:25:07Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=4f05f7e3-6b1d-42bb-a567-ebfab8001772,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4720014-5ce3-41b2-80e7-02fc430417f3", "address": "fa:16:3e:f0:2e:55", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4720014-5c", "ovs_interfaceid": "d4720014-5ce3-41b2-80e7-02fc430417f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "d4720014-5ce3-41b2-80e7-02fc430417f3", "address": "fa:16:3e:f0:2e:55", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4720014-5c", "ovs_interfaceid": "d4720014-5ce3-41b2-80e7-02fc430417f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:2e:55,bridge_name='br-int',has_traffic_filtering=True,id=d4720014-5ce3-41b2-80e7-02fc430417f3,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4720014-5c') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_vif [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:2e:55,bridge_name='br-int',has_traffic_filtering=True,id=d4720014-5ce3-41b2-80e7-02fc430417f3,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4720014-5c') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4720014-5c, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:29:34 user nova-compute[71692]: INFO os_vif [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:2e:55,bridge_name='br-int',has_traffic_filtering=True,id=d4720014-5ce3-41b2-80e7-02fc430417f3,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4720014-5c')
Apr 13 19:29:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kQVmxwZR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:29:34 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d04bfea-8d34-4d9d-ae87-1d43efe46042]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:29:34 user nova-compute[71692]: No targets found.
Apr 13 19:29:34 user nova-compute[71692]: iSNS:
Apr 13 19:29:34 user nova-compute[71692]: No targets found.
Apr 13 19:29:34 user nova-compute[71692]: STATIC:
Apr 13 19:29:34 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777
Apr 13 19:29:34 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:29:34 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:29:34 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5
Apr 13 19:29:34 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:29:34 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:29:34 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945
Apr 13 19:29:34 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:29:34 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:29:34 user nova-compute[71692]: FIRMWARE:
Apr 13 19:29:34 user nova-compute[71692]: No targets found.
Apr 13 19:29:34 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:29:34 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:29:34 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bf7350-1a6e-4555-a8fa-0ec453800748]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96790eb-abde-44c5-98e9-3d93f721269a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:29:34 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:29:34 user nova-compute[71692]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)
Apr 13 19:29:34 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:29:34 user nova-compute[71692]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 (non-flash)
Apr 13 19:29:34 user nova-compute[71692]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)
Apr 13 19:29:34 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feba0545c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5'): ({'sdc'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Removing single pathed devices sdc {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cd5404-5ebb-42c2-9746-53997432e14c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39ae12f-6b9c-43f7-8cf8-3497da4edfc4]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flushing IO for device /dev/sdc {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeba8ac7-86b0-453d-8b56-69a073e6b8b5]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2879a83e-c7c9-4dfe-9b27-18d4df43c61d]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23964643839336534', '/dev/disk/by-id/scsi-1SCST_BIO282582b1-9dd893e45d02bcce', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_282582b1') {{(pid=82243) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[268bf8ad-8718-4c88-93f4-359e50c1b5f1]: (4, None) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8179e7f-db6e-45de-8b93-e7eaa52b3cd7]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:29:34 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee7458a-da89-453e-b47f-bd46af5e722e]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5, portal: 172.16.0.220,3260]
Apr 13 19:29:35 user nova-compute[71692]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5, portal: 172.16.0.220,3260] successful.
Apr 13 19:29:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:29:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6002893f-ec8f-478d-89e7-2761f21a1ed5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1928ad88-242f-445d-ba1c-e2f2a3aba474]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:29:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:29:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:29:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== disconnect_volume: return (323ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:29:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:29:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Deleting instance files /opt/stack/data/nova/instances/4f05f7e3-6b1d-42bb-a567-ebfab8001772_del
Apr 13 19:29:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Deletion of /opt/stack/data/nova/instances/4f05f7e3-6b1d-42bb-a567-ebfab8001772_del complete
Apr 13 19:29:35 user nova-compute[71692]: INFO nova.compute.manager [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 13 19:29:35 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:29:35 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:29:35 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:29:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:35 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:29:36 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Took 0.88 seconds to deallocate network for instance.
Apr 13 19:29:36 user nova-compute[71692]: DEBUG nova.compute.manager [req-cc8644f8-f86d-43b1-8d40-b8fe9634d4e6 req-114b92e7-3d6e-4dce-ba24-1d3abfc2a22e service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Received event network-vif-deleted-d4720014-5ce3-41b2-80e7-02fc430417f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:29:36 user nova-compute[71692]: INFO nova.compute.manager [req-cc8644f8-f86d-43b1-8d40-b8fe9634d4e6 req-114b92e7-3d6e-4dce-ba24-1d3abfc2a22e service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Neutron deleted interface d4720014-5ce3-41b2-80e7-02fc430417f3; detaching it from the instance and deleting it from the info cache
Apr 13 19:29:36 user nova-compute[71692]: DEBUG nova.network.neutron [req-cc8644f8-f86d-43b1-8d40-b8fe9634d4e6 req-114b92e7-3d6e-4dce-ba24-1d3abfc2a22e service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:29:36 user nova-compute[71692]: DEBUG nova.compute.manager [req-cc8644f8-f86d-43b1-8d40-b8fe9634d4e6 req-114b92e7-3d6e-4dce-ba24-1d3abfc2a22e service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Detach interface failed, port_id=d4720014-5ce3-41b2-80e7-02fc430417f3, reason: Instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772 could not be found. {{(pid=71692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 19:29:36 user nova-compute[71692]: DEBUG nova.compute.manager [req-ab7ea6fa-cb6e-489f-ab3b-fdcea4b6fb72 req-aaa30b7a-ddf4-4fe4-aeb2-62c730f32e2d service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Received event network-vif-plugged-d4720014-5ce3-41b2-80e7-02fc430417f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:29:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ab7ea6fa-cb6e-489f-ab3b-fdcea4b6fb72 req-aaa30b7a-ddf4-4fe4-aeb2-62c730f32e2d service nova] Acquiring lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:29:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ab7ea6fa-cb6e-489f-ab3b-fdcea4b6fb72 req-aaa30b7a-ddf4-4fe4-aeb2-62c730f32e2d service nova] Lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:29:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ab7ea6fa-cb6e-489f-ab3b-fdcea4b6fb72 req-aaa30b7a-ddf4-4fe4-aeb2-62c730f32e2d service nova] Lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:29:36 user nova-compute[71692]: DEBUG nova.compute.manager [req-ab7ea6fa-cb6e-489f-ab3b-fdcea4b6fb72 req-aaa30b7a-ddf4-4fe4-aeb2-62c730f32e2d service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] No waiting events found dispatching network-vif-plugged-d4720014-5ce3-41b2-80e7-02fc430417f3 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:29:36 user nova-compute[71692]: WARNING nova.compute.manager [req-ab7ea6fa-cb6e-489f-ab3b-fdcea4b6fb72 req-aaa30b7a-ddf4-4fe4-aeb2-62c730f32e2d service nova] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Received unexpected event network-vif-plugged-d4720014-5ce3-41b2-80e7-02fc430417f3 for instance with vm_state active and task_state deleting.
Apr 13 19:29:36 user nova-compute[71692]: INFO nova.compute.manager [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Took 0.78 seconds to detach 1 volumes for instance.
Apr 13 19:29:36 user nova-compute[71692]: DEBUG nova.compute.manager [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Deleting volume: 6002893f-ec8f-478d-89e7-2761f21a1ed5 {{(pid=71692) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 19:29:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:29:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:29:37 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:29:37 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:29:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:29:37 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Deleted allocations for instance 4f05f7e3-6b1d-42bb-a567-ebfab8001772
Apr 13 19:29:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-8656bb21-cb44-4a20-82e1-3378ab79ac95 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "4f05f7e3-6b1d-42bb-a567-ebfab8001772" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.280s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:29:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:29:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:29:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:29:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:29:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:49 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681414174.699312, 4f05f7e3-6b1d-42bb-a567-ebfab8001772 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:29:49 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] VM Stopped (Lifecycle Event)
Apr 13 19:29:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c4348069-8587-4347-aeb7-78881bc333e3 None None] [instance: 4f05f7e3-6b1d-42bb-a567-ebfab8001772] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:29:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:54 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:29:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:56 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:29:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:29:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:29:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:29:56 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:29:56 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Updating instance_info_cache with network_info: [{"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:29:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:29:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:29:57 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:29:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:30:00 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:30:00 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:30:00 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8591MB free_disk=25.928531646728516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:30:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:30:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:30:00 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:30:00 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:30:00 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:30:00 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:30:00 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:30:00 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:30:00 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:30:00 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:30:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:30:01 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:30:01 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:30:01 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:30:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:30:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:30:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:30:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:30:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:30:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:30:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:30:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:30:10 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:30:10 user nova-compute[71692]: INFO nova.compute.claims [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Claim successful on node user
Apr 13 19:30:11 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG nova.network.neutron [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:30:11 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:30:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG nova.policy [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:30:11 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Creating image(s)
Apr 13 19:30:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "/opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "/opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk 1073741824" returned: 0 in 0.053s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.149s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:30:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Successfully created port: 89ac5520-b022-42dd-a10d-6621de9ecd5f {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:30:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:12 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Cannot resize image /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:30:12 user nova-compute[71692]: DEBUG nova.objects.instance [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'migration_context' on Instance uuid fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:30:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:30:12 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Ensure instance console log exists: /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:30:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:30:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:30:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:30:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Successfully updated port: 89ac5520-b022-42dd-a10d-6621de9ecd5f {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:30:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "refresh_cache-fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:30:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquired lock "refresh_cache-fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:30:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:30:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-dc49e7a5-0c4d-4b15-8745-3d662dfd4860 req-8d70871f-73d2-4e84-8cf2-eed8c94d7476 service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Received event network-changed-89ac5520-b022-42dd-a10d-6621de9ecd5f {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:30:12 user nova-compute[71692]: DEBUG nova.compute.manager [req-dc49e7a5-0c4d-4b15-8745-3d662dfd4860 req-8d70871f-73d2-4e84-8cf2-eed8c94d7476 service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Refreshing instance network info cache due to event network-changed-89ac5520-b022-42dd-a10d-6621de9ecd5f. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:30:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dc49e7a5-0c4d-4b15-8745-3d662dfd4860 req-8d70871f-73d2-4e84-8cf2-eed8c94d7476 service nova] Acquiring lock "refresh_cache-fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:30:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.network.neutron [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Updating instance_info_cache with network_info: [{"id": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "address": "fa:16:3e:c5:4f:ac", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ac5520-b0", "ovs_interfaceid": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Releasing lock "refresh_cache-fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Instance network_info: |[{"id": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "address": "fa:16:3e:c5:4f:ac", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ac5520-b0", "ovs_interfaceid": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dc49e7a5-0c4d-4b15-8745-3d662dfd4860 req-8d70871f-73d2-4e84-8cf2-eed8c94d7476 service nova] Acquired lock "refresh_cache-fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.network.neutron [req-dc49e7a5-0c4d-4b15-8745-3d662dfd4860 req-8d70871f-73d2-4e84-8cf2-eed8c94d7476 service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Refreshing network info cache for port 89ac5520-b022-42dd-a10d-6621de9ecd5f {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Start _get_guest_xml network_info=[{"id": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "address": "fa:16:3e:c5:4f:ac", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ac5520-b0", "ovs_interfaceid": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:30:13 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:30:13 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1651036996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1651036996',id=41,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c00a7fcd6d3040e8b2db0448eeda93ad',ramdisk_id='',reservation_id='r-fo5x2kms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:30:11Z,user_data=None,user_id='dd604fa4d17b42b1abea8c2f2405b58d',uuid=fd2fe4b2-e5ae-487f-bda2-6b3102204ad6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "address": "fa:16:3e:c5:4f:ac", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ac5520-b0", "ovs_interfaceid": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converting VIF {"id": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "address": "fa:16:3e:c5:4f:ac", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ac5520-b0", "ovs_interfaceid": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4f:ac,bridge_name='br-int',has_traffic_filtering=True,id=89ac5520-b022-42dd-a10d-6621de9ecd5f,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ac5520-b0') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.objects.instance [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'pci_devices' on Instance uuid fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:30:13 user nova-compute[71692]:   <uuid>fd2fe4b2-e5ae-487f-bda2-6b3102204ad6</uuid>
Apr 13 19:30:13 user nova-compute[71692]:   <name>instance-00000029</name>
Apr 13 19:30:13 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:30:13 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:30:13 user nova-compute[71692]:   <metadata>
Apr 13 19:30:13 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:30:13 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:30:13 user nova-compute[71692]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1651036996</nova:name>
Apr 13 19:30:13 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:30:13</nova:creationTime>
Apr 13 19:30:13 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:30:13 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:30:13 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:30:13 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:30:13 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:30:13 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:30:13 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:30:13 user nova-compute[71692]:       <nova:owner>
Apr 13 19:30:13 user nova-compute[71692]:         <nova:user uuid="dd604fa4d17b42b1abea8c2f2405b58d">tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member</nova:user>
Apr 13 19:30:13 user nova-compute[71692]:         <nova:project uuid="c00a7fcd6d3040e8b2db0448eeda93ad">tempest-ServerBootFromVolumeStableRescueTest-1051313256</nova:project>
Apr 13 19:30:13 user nova-compute[71692]:       </nova:owner>
Apr 13 19:30:13 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:30:13 user nova-compute[71692]:       <nova:ports>
Apr 13 19:30:13 user nova-compute[71692]:         <nova:port uuid="89ac5520-b022-42dd-a10d-6621de9ecd5f">
Apr 13 19:30:13 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 19:30:13 user nova-compute[71692]:         </nova:port>
Apr 13 19:30:13 user nova-compute[71692]:       </nova:ports>
Apr 13 19:30:13 user nova-compute[71692]:     </nova:instance>
Apr 13 19:30:13 user nova-compute[71692]:   </metadata>
Apr 13 19:30:13 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:30:13 user nova-compute[71692]:     <system>
Apr 13 19:30:13 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:30:13 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:30:13 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:30:13 user nova-compute[71692]:       <entry name="serial">fd2fe4b2-e5ae-487f-bda2-6b3102204ad6</entry>
Apr 13 19:30:13 user nova-compute[71692]:       <entry name="uuid">fd2fe4b2-e5ae-487f-bda2-6b3102204ad6</entry>
Apr 13 19:30:13 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:30:13 user nova-compute[71692]:     </system>
Apr 13 19:30:13 user nova-compute[71692]:   </sysinfo>
Apr 13 19:30:13 user nova-compute[71692]:   <os>
Apr 13 19:30:13 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:30:13 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:30:13 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:30:13 user nova-compute[71692]:   </os>
Apr 13 19:30:13 user nova-compute[71692]:   <features>
Apr 13 19:30:13 user nova-compute[71692]:     <acpi/>
Apr 13 19:30:13 user nova-compute[71692]:     <apic/>
Apr 13 19:30:13 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:30:13 user nova-compute[71692]:   </features>
Apr 13 19:30:13 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:30:13 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:30:13 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:30:13 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:30:13 user nova-compute[71692]:   </clock>
Apr 13 19:30:13 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:30:13 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:30:13 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:30:13 user nova-compute[71692]:   </cpu>
Apr 13 19:30:13 user nova-compute[71692]:   <devices>
Apr 13 19:30:13 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:30:13 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:30:13 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk"/>
Apr 13 19:30:13 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:30:13 user nova-compute[71692]:     </disk>
Apr 13 19:30:13 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:30:13 user nova-compute[71692]:       <mac address="fa:16:3e:c5:4f:ac"/>
Apr 13 19:30:13 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:30:13 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:30:13 user nova-compute[71692]:       <target dev="tap89ac5520-b0"/>
Apr 13 19:30:13 user nova-compute[71692]:     </interface>
Apr 13 19:30:13 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:30:13 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/console.log" append="off"/>
Apr 13 19:30:13 user nova-compute[71692]:     </serial>
Apr 13 19:30:13 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:30:13 user nova-compute[71692]:     <video>
Apr 13 19:30:13 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:30:13 user nova-compute[71692]:     </video>
Apr 13 19:30:13 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:30:13 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:30:13 user nova-compute[71692]:     </rng>
Apr 13 19:30:13 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:30:13 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:30:13 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:30:13 user nova-compute[71692]:     </memballoon>
Apr 13 19:30:13 user nova-compute[71692]:   </devices>
Apr 13 19:30:13 user nova-compute[71692]: </domain>
Apr 13 19:30:13 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1651036996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1651036996',id=41,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c00a7fcd6d3040e8b2db0448eeda93ad',ramdisk_id='',reservation_id='r-fo5x2kms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:30:11Z,user_data=None,user_id='dd604fa4d17b42b1abea8c2f2405b58d',uuid=fd2fe4b2-e5ae-487f-bda2-6b3102204ad6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "address": "fa:16:3e:c5:4f:ac", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ac5520-b0", "ovs_interfaceid": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converting VIF {"id": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "address": "fa:16:3e:c5:4f:ac", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ac5520-b0", "ovs_interfaceid": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4f:ac,bridge_name='br-int',has_traffic_filtering=True,id=89ac5520-b022-42dd-a10d-6621de9ecd5f,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ac5520-b0') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG os_vif [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4f:ac,bridge_name='br-int',has_traffic_filtering=True,id=89ac5520-b022-42dd-a10d-6621de9ecd5f,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ac5520-b0') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89ac5520-b0, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89ac5520-b0, col_values=(('external_ids', {'iface-id': '89ac5520-b022-42dd-a10d-6621de9ecd5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:4f:ac', 'vm-uuid': 'fd2fe4b2-e5ae-487f-bda2-6b3102204ad6'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:13 user nova-compute[71692]: INFO os_vif [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:4f:ac,bridge_name='br-int',has_traffic_filtering=True,id=89ac5520-b022-42dd-a10d-6621de9ecd5f,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ac5520-b0')
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] No VIF found with MAC fa:16:3e:c5:4f:ac, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.network.neutron [req-dc49e7a5-0c4d-4b15-8745-3d662dfd4860 req-8d70871f-73d2-4e84-8cf2-eed8c94d7476 service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Updated VIF entry in instance network info cache for port 89ac5520-b022-42dd-a10d-6621de9ecd5f. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG nova.network.neutron [req-dc49e7a5-0c4d-4b15-8745-3d662dfd4860 req-8d70871f-73d2-4e84-8cf2-eed8c94d7476 service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Updating instance_info_cache with network_info: [{"id": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "address": "fa:16:3e:c5:4f:ac", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ac5520-b0", "ovs_interfaceid": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:30:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dc49e7a5-0c4d-4b15-8745-3d662dfd4860 req-8d70871f-73d2-4e84-8cf2-eed8c94d7476 service nova] Releasing lock "refresh_cache-fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:30:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-e1917db6-da4d-462b-bd7b-905ddf56e8aa req-1b49fe89-770a-41f4-b063-4ed9a38dd051 service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Received event network-vif-plugged-89ac5520-b022-42dd-a10d-6621de9ecd5f {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:30:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e1917db6-da4d-462b-bd7b-905ddf56e8aa req-1b49fe89-770a-41f4-b063-4ed9a38dd051 service nova] Acquiring lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:30:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e1917db6-da4d-462b-bd7b-905ddf56e8aa req-1b49fe89-770a-41f4-b063-4ed9a38dd051 service nova] Lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:30:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e1917db6-da4d-462b-bd7b-905ddf56e8aa req-1b49fe89-770a-41f4-b063-4ed9a38dd051 service nova] Lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:30:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-e1917db6-da4d-462b-bd7b-905ddf56e8aa req-1b49fe89-770a-41f4-b063-4ed9a38dd051 service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] No waiting events found dispatching network-vif-plugged-89ac5520-b022-42dd-a10d-6621de9ecd5f {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:30:14 user nova-compute[71692]: WARNING nova.compute.manager [req-e1917db6-da4d-462b-bd7b-905ddf56e8aa req-1b49fe89-770a-41f4-b063-4ed9a38dd051 service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Received unexpected event network-vif-plugged-89ac5520-b022-42dd-a10d-6621de9ecd5f for instance with vm_state building and task_state spawning.
Apr 13 19:30:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414216.6173422, fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:30:16 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] VM Resumed (Lifecycle Event)
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.compute.manager [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:30:16 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Instance spawned successfully.
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:30:16 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414216.618936, fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:30:16 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] VM Started (Lifecycle Event)
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:30:16 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:30:16 user nova-compute[71692]: INFO nova.compute.manager [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Took 5.32 seconds to spawn the instance on the hypervisor.
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.compute.manager [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:30:16 user nova-compute[71692]: INFO nova.compute.manager [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Took 5.85 seconds to build instance.
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-163a34ef-c4c8-416e-a534-9c75e6762a99 req-15e11c44-0571-46e2-b978-644d9d279979 service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Received event network-vif-plugged-89ac5520-b022-42dd-a10d-6621de9ecd5f {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:30:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-163a34ef-c4c8-416e-a534-9c75e6762a99 req-15e11c44-0571-46e2-b978-644d9d279979 service nova] Acquiring lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:30:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-163a34ef-c4c8-416e-a534-9c75e6762a99 req-15e11c44-0571-46e2-b978-644d9d279979 service nova] Lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:30:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-163a34ef-c4c8-416e-a534-9c75e6762a99 req-15e11c44-0571-46e2-b978-644d9d279979 service nova] Lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:30:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-163a34ef-c4c8-416e-a534-9c75e6762a99 req-15e11c44-0571-46e2-b978-644d9d279979 service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] No waiting events found dispatching network-vif-plugged-89ac5520-b022-42dd-a10d-6621de9ecd5f {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:30:16 user nova-compute[71692]: WARNING nova.compute.manager [req-163a34ef-c4c8-416e-a534-9c75e6762a99 req-15e11c44-0571-46e2-b978-644d9d279979 service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Received unexpected event network-vif-plugged-89ac5520-b022-42dd-a10d-6621de9ecd5f for instance with vm_state active and task_state None.
Apr 13 19:30:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-88514748-e44b-4f4f-8d56-49a4db624db8 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.947s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:30:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:30:30 user nova-compute[71692]: INFO nova.compute.claims [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Claim successful on node user
Apr 13 19:30:30 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG nova.network.neutron [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:30:30 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:30:30 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:30:30 user nova-compute[71692]: INFO nova.virt.block_device [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Booting with volume 859d56a6-4c86-402c-9b6c-564c027c53d5 at /dev/vda
Apr 13 19:30:30 user nova-compute[71692]: DEBUG nova.policy [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG os_brick.utils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd41483-9c8d-46b2-8f1f-5a60f248427f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8687f3-9499-40bb-b509-52c2aeab5b41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb5cc52-37fe-497d-aee6-31275673052c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c57b47-9333-4819-86be-3742ffecbde8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:30:30 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:30:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2af552-d425-46e1-ad53-057bd1042b5c]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG os_brick.utils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:30:30 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Updating existing volume attachment record: 7f2cc6fe-f0a7-4517-9afe-1ce05092949e {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:30:31 user nova-compute[71692]: DEBUG nova.network.neutron [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Successfully created port: 78719f53-87de-44f2-b6f3-f2d77851fce0 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:30:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:32 user nova-compute[71692]: DEBUG nova.network.neutron [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Successfully updated port: 78719f53-87de-44f2-b6f3-f2d77851fce0 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:30:32 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "refresh_cache-bbd7e115-1fc0-4c57-8ed8-eee343b69800" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:30:32 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquired lock "refresh_cache-bbd7e115-1fc0-4c57-8ed8-eee343b69800" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:30:32 user nova-compute[71692]: DEBUG nova.network.neutron [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:30:32 user nova-compute[71692]: DEBUG nova.compute.manager [req-bf137fad-1542-4467-a18c-d87c4371171e req-70b0549a-fa95-40a7-b3cf-adc18136b0d3 service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Received event network-changed-78719f53-87de-44f2-b6f3-f2d77851fce0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:30:32 user nova-compute[71692]: DEBUG nova.compute.manager [req-bf137fad-1542-4467-a18c-d87c4371171e req-70b0549a-fa95-40a7-b3cf-adc18136b0d3 service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Refreshing instance network info cache due to event network-changed-78719f53-87de-44f2-b6f3-f2d77851fce0. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:30:32 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-bf137fad-1542-4467-a18c-d87c4371171e req-70b0549a-fa95-40a7-b3cf-adc18136b0d3 service nova] Acquiring lock "refresh_cache-bbd7e115-1fc0-4c57-8ed8-eee343b69800" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:30:32 user nova-compute[71692]: DEBUG nova.network.neutron [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:30:32 user nova-compute[71692]: DEBUG nova.network.neutron [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Updating instance_info_cache with network_info: [{"id": "78719f53-87de-44f2-b6f3-f2d77851fce0", "address": "fa:16:3e:a1:24:98", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78719f53-87", "ovs_interfaceid": "78719f53-87de-44f2-b6f3-f2d77851fce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:30:32 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Releasing lock "refresh_cache-bbd7e115-1fc0-4c57-8ed8-eee343b69800" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:30:32 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Instance network_info: |[{"id": "78719f53-87de-44f2-b6f3-f2d77851fce0", "address": "fa:16:3e:a1:24:98", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78719f53-87", "ovs_interfaceid": "78719f53-87de-44f2-b6f3-f2d77851fce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:30:32 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-bf137fad-1542-4467-a18c-d87c4371171e req-70b0549a-fa95-40a7-b3cf-adc18136b0d3 service nova] Acquired lock "refresh_cache-bbd7e115-1fc0-4c57-8ed8-eee343b69800" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:30:32 user nova-compute[71692]: DEBUG nova.network.neutron [req-bf137fad-1542-4467-a18c-d87c4371171e req-70b0549a-fa95-40a7-b3cf-adc18136b0d3 service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Refreshing network info cache for port 78719f53-87de-44f2-b6f3-f2d77851fce0 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:30:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:33 user nova-compute[71692]: DEBUG nova.network.neutron [req-bf137fad-1542-4467-a18c-d87c4371171e req-70b0549a-fa95-40a7-b3cf-adc18136b0d3 service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Updated VIF entry in instance network info cache for port 78719f53-87de-44f2-b6f3-f2d77851fce0. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:30:33 user nova-compute[71692]: DEBUG nova.network.neutron [req-bf137fad-1542-4467-a18c-d87c4371171e req-70b0549a-fa95-40a7-b3cf-adc18136b0d3 service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Updating instance_info_cache with network_info: [{"id": "78719f53-87de-44f2-b6f3-f2d77851fce0", "address": "fa:16:3e:a1:24:98", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78719f53-87", "ovs_interfaceid": "78719f53-87de-44f2-b6f3-f2d77851fce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:30:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-bf137fad-1542-4467-a18c-d87c4371171e req-70b0549a-fa95-40a7-b3cf-adc18136b0d3 service nova] Releasing lock "refresh_cache-bbd7e115-1fc0-4c57-8ed8-eee343b69800" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:30:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Creating image(s)
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Did not create local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Ensure instance console log exists: /opt/stack/data/nova/instances/bbd7e115-1fc0-4c57-8ed8-eee343b69800/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Start _get_guest_xml network_info=[{"id": "78719f53-87de-44f2-b6f3-f2d77851fce0", "address": "fa:16:3e:a1:24:98", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78719f53-87", "ovs_interfaceid": "78719f53-87de-44f2-b6f3-f2d77851fce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '7f2cc6fe-f0a7-4517-9afe-1ce05092949e', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZFKraEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bbd7e115-1fc0-4c57-8ed8-eee343b69800', 'attached_at': '', 'detached_at': '', 'volume_id': '859d56a6-4c86-402c-9b6c-564c027c53d5', 'serial': '859d56a6-4c86-402c-9b6c-564c027c53d5'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:30:35 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:30:35 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZFKraEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:30:35 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:30:35 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:30:35 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bdd710-11c6-47ad-b70d-0029c10fe736]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:30:35 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8084bbc6-50ba-4935-a501-8bc1fd511d81]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5] added
Apr 13 19:30:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6398de5-81b4-42fc-83b9-02abc350d250]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c868df-d854-42dd-9fe0-9fe548e80fe8]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qZFKraEx {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qZFKraEx" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[392e3a42-a147-4bd2-bdc3-2a7fd2542794]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qZFKraEx'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87fd827-ed7b-48b4-a28b-efe07d72a4c5]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c980ce2a-2b59-445f-84c5-f2d454ff4401]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:30:35 user nova-compute[71692]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)
Apr 13 19:30:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:30:35 user nova-compute[71692]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)
Apr 13 19:30:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6454adef-26a4-4374-bdac-02457cd70099]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5, portal: 172.16.0.220,3260]
Apr 13 19:30:35 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5, portal: 172.16.0.220,3260] successful.
Apr 13 19:30:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41a30ca-4f9a-48d5-a262-272563fa6578]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27b3b4b-1f82-4b0b-a14e-6c73f7126b34]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:30:35 user nova-compute[71692]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)
Apr 13 19:30:35 user nova-compute[71692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:30:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:30:35 user nova-compute[71692]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)
Apr 13 19:30:35 user nova-compute[71692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:30:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82d82de-bd8c-4165-8a71-860115d0cf43]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:30:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZFKraEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23665666335633461', 'path': '/dev/sdc'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665666335633461', 'path': '/dev/sdc'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:30:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-46900522',display_name='tempest-TestVolumeBootPattern-server-46900522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-46900522',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj7TcL9FU0ycuamYqYTfleaq2m4r0SEirSHRlkPBcG/eCMlwnGnrLneKNOsIY4WhqDyz6ZvULFdimsQ4U+9lxxBdfuyuTJJKa1K6nRrg6kFRx2pkuS1DtxEUpZtRdywRA==',key_name='tempest-TestVolumeBootPattern-1410205426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-l2oaaddo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:30:31Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=bbd7e115-1fc0-4c57-8ed8-eee343b69800,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78719f53-87de-44f2-b6f3-f2d77851fce0", "address": "fa:16:3e:a1:24:98", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78719f53-87", "ovs_interfaceid": "78719f53-87de-44f2-b6f3-f2d77851fce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "78719f53-87de-44f2-b6f3-f2d77851fce0", "address": "fa:16:3e:a1:24:98", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78719f53-87", "ovs_interfaceid": "78719f53-87de-44f2-b6f3-f2d77851fce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:24:98,bridge_name='br-int',has_traffic_filtering=True,id=78719f53-87de-44f2-b6f3-f2d77851fce0,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78719f53-87') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG nova.objects.instance [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lazy-loading 'pci_devices' on Instance uuid bbd7e115-1fc0-4c57-8ed8-eee343b69800 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:30:36 user nova-compute[71692]:   <uuid>bbd7e115-1fc0-4c57-8ed8-eee343b69800</uuid>
Apr 13 19:30:36 user nova-compute[71692]:   <name>instance-0000002a</name>
Apr 13 19:30:36 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:30:36 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:30:36 user nova-compute[71692]:   <metadata>
Apr 13 19:30:36 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:30:36 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:30:36 user nova-compute[71692]:       <nova:name>tempest-TestVolumeBootPattern-server-46900522</nova:name>
Apr 13 19:30:36 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:30:35</nova:creationTime>
Apr 13 19:30:36 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:30:36 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:30:36 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:30:36 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:30:36 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:30:36 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:30:36 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:30:36 user nova-compute[71692]:       <nova:owner>
Apr 13 19:30:36 user nova-compute[71692]:         <nova:user uuid="526d9c809b81418d89da662f973a1bdc">tempest-TestVolumeBootPattern-1717000141-project-member</nova:user>
Apr 13 19:30:36 user nova-compute[71692]:         <nova:project uuid="a5231d999e51417ebe91927707bfd2bd">tempest-TestVolumeBootPattern-1717000141</nova:project>
Apr 13 19:30:36 user nova-compute[71692]:       </nova:owner>
Apr 13 19:30:36 user nova-compute[71692]:       <nova:ports>
Apr 13 19:30:36 user nova-compute[71692]:         <nova:port uuid="78719f53-87de-44f2-b6f3-f2d77851fce0">
Apr 13 19:30:36 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 19:30:36 user nova-compute[71692]:         </nova:port>
Apr 13 19:30:36 user nova-compute[71692]:       </nova:ports>
Apr 13 19:30:36 user nova-compute[71692]:     </nova:instance>
Apr 13 19:30:36 user nova-compute[71692]:   </metadata>
Apr 13 19:30:36 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:30:36 user nova-compute[71692]:     <system>
Apr 13 19:30:36 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:30:36 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:30:36 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:30:36 user nova-compute[71692]:       <entry name="serial">bbd7e115-1fc0-4c57-8ed8-eee343b69800</entry>
Apr 13 19:30:36 user nova-compute[71692]:       <entry name="uuid">bbd7e115-1fc0-4c57-8ed8-eee343b69800</entry>
Apr 13 19:30:36 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:30:36 user nova-compute[71692]:     </system>
Apr 13 19:30:36 user nova-compute[71692]:   </sysinfo>
Apr 13 19:30:36 user nova-compute[71692]:   <os>
Apr 13 19:30:36 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:30:36 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:30:36 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:30:36 user nova-compute[71692]:   </os>
Apr 13 19:30:36 user nova-compute[71692]:   <features>
Apr 13 19:30:36 user nova-compute[71692]:     <acpi/>
Apr 13 19:30:36 user nova-compute[71692]:     <apic/>
Apr 13 19:30:36 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:30:36 user nova-compute[71692]:   </features>
Apr 13 19:30:36 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:30:36 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:30:36 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:30:36 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:30:36 user nova-compute[71692]:   </clock>
Apr 13 19:30:36 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:30:36 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:30:36 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:30:36 user nova-compute[71692]:   </cpu>
Apr 13 19:30:36 user nova-compute[71692]:   <devices>
Apr 13 19:30:36 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:30:36 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:30:36 user nova-compute[71692]:       <source dev="/dev/sdc"/>
Apr 13 19:30:36 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:30:36 user nova-compute[71692]:       <serial>859d56a6-4c86-402c-9b6c-564c027c53d5</serial>
Apr 13 19:30:36 user nova-compute[71692]:     </disk>
Apr 13 19:30:36 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:30:36 user nova-compute[71692]:       <mac address="fa:16:3e:a1:24:98"/>
Apr 13 19:30:36 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:30:36 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:30:36 user nova-compute[71692]:       <target dev="tap78719f53-87"/>
Apr 13 19:30:36 user nova-compute[71692]:     </interface>
Apr 13 19:30:36 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:30:36 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/bbd7e115-1fc0-4c57-8ed8-eee343b69800/console.log" append="off"/>
Apr 13 19:30:36 user nova-compute[71692]:     </serial>
Apr 13 19:30:36 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:30:36 user nova-compute[71692]:     <video>
Apr 13 19:30:36 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:30:36 user nova-compute[71692]:     </video>
Apr 13 19:30:36 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:30:36 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:30:36 user nova-compute[71692]:     </rng>
Apr 13 19:30:36 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:30:36 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:30:36 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:30:36 user nova-compute[71692]:     </memballoon>
Apr 13 19:30:36 user nova-compute[71692]:   </devices>
Apr 13 19:30:36 user nova-compute[71692]: </domain>
Apr 13 19:30:36 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:30:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-46900522',display_name='tempest-TestVolumeBootPattern-server-46900522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-46900522',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj7TcL9FU0ycuamYqYTfleaq2m4r0SEirSHRlkPBcG/eCMlwnGnrLneKNOsIY4WhqDyz6ZvULFdimsQ4U+9lxxBdfuyuTJJKa1K6nRrg6kFRx2pkuS1DtxEUpZtRdywRA==',key_name='tempest-TestVolumeBootPattern-1410205426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-l2oaaddo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:30:31Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=bbd7e115-1fc0-4c57-8ed8-eee343b69800,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78719f53-87de-44f2-b6f3-f2d77851fce0", "address": "fa:16:3e:a1:24:98", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78719f53-87", "ovs_interfaceid": "78719f53-87de-44f2-b6f3-f2d77851fce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "78719f53-87de-44f2-b6f3-f2d77851fce0", "address": "fa:16:3e:a1:24:98", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78719f53-87", "ovs_interfaceid": "78719f53-87de-44f2-b6f3-f2d77851fce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:24:98,bridge_name='br-int',has_traffic_filtering=True,id=78719f53-87de-44f2-b6f3-f2d77851fce0,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78719f53-87') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG os_vif [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:24:98,bridge_name='br-int',has_traffic_filtering=True,id=78719f53-87de-44f2-b6f3-f2d77851fce0,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78719f53-87') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78719f53-87, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap78719f53-87, col_values=(('external_ids', {'iface-id': '78719f53-87de-44f2-b6f3-f2d77851fce0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:24:98', 'vm-uuid': 'bbd7e115-1fc0-4c57-8ed8-eee343b69800'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:36 user nova-compute[71692]: INFO os_vif [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:24:98,bridge_name='br-int',has_traffic_filtering=True,id=78719f53-87de-44f2-b6f3-f2d77851fce0,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78719f53-87')
Apr 13 19:30:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:30:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] No VIF found with MAC fa:16:3e:a1:24:98, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:30:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:38 user nova-compute[71692]: DEBUG nova.compute.manager [req-961c8144-34b5-46eb-8a7f-7876053d9ff9 req-503a66f6-51e4-43b1-a519-9836fd106412 service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Received event network-vif-plugged-78719f53-87de-44f2-b6f3-f2d77851fce0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:30:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-961c8144-34b5-46eb-8a7f-7876053d9ff9 req-503a66f6-51e4-43b1-a519-9836fd106412 service nova] Acquiring lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:30:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-961c8144-34b5-46eb-8a7f-7876053d9ff9 req-503a66f6-51e4-43b1-a519-9836fd106412 service nova] Lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:30:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-961c8144-34b5-46eb-8a7f-7876053d9ff9 req-503a66f6-51e4-43b1-a519-9836fd106412 service nova] Lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:30:38 user nova-compute[71692]: DEBUG nova.compute.manager [req-961c8144-34b5-46eb-8a7f-7876053d9ff9 req-503a66f6-51e4-43b1-a519-9836fd106412 service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] No waiting events found dispatching network-vif-plugged-78719f53-87de-44f2-b6f3-f2d77851fce0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:30:38 user nova-compute[71692]: WARNING nova.compute.manager [req-961c8144-34b5-46eb-8a7f-7876053d9ff9 req-503a66f6-51e4-43b1-a519-9836fd106412 service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Received unexpected event network-vif-plugged-78719f53-87de-44f2-b6f3-f2d77851fce0 for instance with vm_state building and task_state spawning.
Apr 13 19:30:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414240.4056845, bbd7e115-1fc0-4c57-8ed8-eee343b69800 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:30:40 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] VM Resumed (Lifecycle Event)
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:30:40 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Instance spawned successfully.
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:30:40 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414240.406807, bbd7e115-1fc0-4c57-8ed8-eee343b69800 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:30:40 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] VM Started (Lifecycle Event)
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-7bbbd861-1efa-4b98-878b-d506ce843776 req-5655a5d2-4349-4d0b-9856-b21766a32c91 service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Received event network-vif-plugged-78719f53-87de-44f2-b6f3-f2d77851fce0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:30:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7bbbd861-1efa-4b98-878b-d506ce843776 req-5655a5d2-4349-4d0b-9856-b21766a32c91 service nova] Acquiring lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:30:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7bbbd861-1efa-4b98-878b-d506ce843776 req-5655a5d2-4349-4d0b-9856-b21766a32c91 service nova] Lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:30:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7bbbd861-1efa-4b98-878b-d506ce843776 req-5655a5d2-4349-4d0b-9856-b21766a32c91 service nova] Lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-7bbbd861-1efa-4b98-878b-d506ce843776 req-5655a5d2-4349-4d0b-9856-b21766a32c91 service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] No waiting events found dispatching network-vif-plugged-78719f53-87de-44f2-b6f3-f2d77851fce0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:30:40 user nova-compute[71692]: WARNING nova.compute.manager [req-7bbbd861-1efa-4b98-878b-d506ce843776 req-5655a5d2-4349-4d0b-9856-b21766a32c91 service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Received unexpected event network-vif-plugged-78719f53-87de-44f2-b6f3-f2d77851fce0 for instance with vm_state building and task_state spawning.
Apr 13 19:30:40 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:30:40 user nova-compute[71692]: INFO nova.compute.manager [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Took 5.14 seconds to spawn the instance on the hypervisor.
Apr 13 19:30:40 user nova-compute[71692]: DEBUG nova.compute.manager [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:30:40 user nova-compute[71692]: INFO nova.compute.manager [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Took 10.51 seconds to build instance.
Apr 13 19:30:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-c468b094-f9f6-455a-aaea-ffc72b230849 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.620s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:30:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:50 user nova-compute[71692]: DEBUG nova.compute.manager [req-070b9919-21bf-4e94-8ea5-3c4806f77abb req-a6feeeae-46af-4d96-bc14-59b86134290d service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received event network-changed-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:30:50 user nova-compute[71692]: DEBUG nova.compute.manager [req-070b9919-21bf-4e94-8ea5-3c4806f77abb req-a6feeeae-46af-4d96-bc14-59b86134290d service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Refreshing instance network info cache due to event network-changed-18d17551-39ea-401c-95cf-acfdafb210d5. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:30:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-070b9919-21bf-4e94-8ea5-3c4806f77abb req-a6feeeae-46af-4d96-bc14-59b86134290d service nova] Acquiring lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:30:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-070b9919-21bf-4e94-8ea5-3c4806f77abb req-a6feeeae-46af-4d96-bc14-59b86134290d service nova] Acquired lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:30:50 user nova-compute[71692]: DEBUG nova.network.neutron [req-070b9919-21bf-4e94-8ea5-3c4806f77abb req-a6feeeae-46af-4d96-bc14-59b86134290d service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Refreshing network info cache for port 18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:30:51 user nova-compute[71692]: DEBUG nova.network.neutron [req-070b9919-21bf-4e94-8ea5-3c4806f77abb req-a6feeeae-46af-4d96-bc14-59b86134290d service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Updated VIF entry in instance network info cache for port 18d17551-39ea-401c-95cf-acfdafb210d5. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:30:51 user nova-compute[71692]: DEBUG nova.network.neutron [req-070b9919-21bf-4e94-8ea5-3c4806f77abb req-a6feeeae-46af-4d96-bc14-59b86134290d service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Updating instance_info_cache with network_info: [{"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:30:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-070b9919-21bf-4e94-8ea5-3c4806f77abb req-a6feeeae-46af-4d96-bc14-59b86134290d service nova] Releasing lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:30:51 user nova-compute[71692]: DEBUG nova.compute.manager [req-b47b28d6-383f-4cab-8b9b-5311dff3446c req-26a148c7-2cc8-4580-84bd-29e138058ae6 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received event network-changed-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:30:51 user nova-compute[71692]: DEBUG nova.compute.manager [req-b47b28d6-383f-4cab-8b9b-5311dff3446c req-26a148c7-2cc8-4580-84bd-29e138058ae6 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Refreshing instance network info cache due to event network-changed-18d17551-39ea-401c-95cf-acfdafb210d5. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:30:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b47b28d6-383f-4cab-8b9b-5311dff3446c req-26a148c7-2cc8-4580-84bd-29e138058ae6 service nova] Acquiring lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:30:51 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b47b28d6-383f-4cab-8b9b-5311dff3446c req-26a148c7-2cc8-4580-84bd-29e138058ae6 service nova] Acquired lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:30:51 user nova-compute[71692]: DEBUG nova.network.neutron [req-b47b28d6-383f-4cab-8b9b-5311dff3446c req-26a148c7-2cc8-4580-84bd-29e138058ae6 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Refreshing network info cache for port 18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:30:52 user nova-compute[71692]: INFO nova.compute.manager [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Detaching volume ec99b355-2456-4eef-af04-cc75aff66777
Apr 13 19:30:52 user nova-compute[71692]: INFO nova.virt.block_device [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Attempting to driver detach volume ec99b355-2456-4eef-af04-cc75aff66777 from mountpoint /dev/vdb
Apr 13 19:30:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Attempting to detach device vdb from instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:30:52 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:30:52 user nova-compute[71692]:   <source dev="/dev/sdd"/>
Apr 13 19:30:52 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:30:52 user nova-compute[71692]:   <serial>ec99b355-2456-4eef-af04-cc75aff66777</serial>
Apr 13 19:30:52 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 19:30:52 user nova-compute[71692]: </disk>
Apr 13 19:30:52 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:30:52 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Successfully detached device vdb from instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 from the persistent domain config.
Apr 13 19:30:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:30:52 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:30:52 user nova-compute[71692]:   <source dev="/dev/sdd"/>
Apr 13 19:30:52 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:30:52 user nova-compute[71692]:   <serial>ec99b355-2456-4eef-af04-cc75aff66777</serial>
Apr 13 19:30:52 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 19:30:52 user nova-compute[71692]: </disk>
Apr 13 19:30:52 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG nova.network.neutron [req-b47b28d6-383f-4cab-8b9b-5311dff3446c req-26a148c7-2cc8-4580-84bd-29e138058ae6 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Updated VIF entry in instance network info cache for port 18d17551-39ea-401c-95cf-acfdafb210d5. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG nova.network.neutron [req-b47b28d6-383f-4cab-8b9b-5311dff3446c req-26a148c7-2cc8-4580-84bd-29e138058ae6 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Updating instance_info_cache with network_info: [{"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b47b28d6-383f-4cab-8b9b-5311dff3446c req-26a148c7-2cc8-4580-84bd-29e138058ae6 service nova] Releasing lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681414252.7100508, 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:30:52 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Successfully detached device vdb from instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 from the live domain config.
Apr 13 19:30:52 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdCcTNKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:30:52 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:30:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a731698-d426-4a41-8579-d09973e2bc8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:30:52 user nova-compute[71692]: No targets found.
Apr 13 19:30:52 user nova-compute[71692]: iSNS:
Apr 13 19:30:52 user nova-compute[71692]: No targets found.
Apr 13 19:30:52 user nova-compute[71692]: STATIC:
Apr 13 19:30:52 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5
Apr 13 19:30:52 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:30:52 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:30:52 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777
Apr 13 19:30:52 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:30:52 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:30:52 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945
Apr 13 19:30:52 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:30:52 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:30:52 user nova-compute[71692]: FIRMWARE:
Apr 13 19:30:52 user nova-compute[71692]: No targets found.
Apr 13 19:30:52 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:30:52 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:30:52 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be44625-e827-4d71-aa33-c1658d329c32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8851d593-6fb4-4d17-968f-d4985b02479b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:30:52 user nova-compute[71692]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)
Apr 13 19:30:52 user nova-compute[71692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:30:52 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:30:52 user nova-compute[71692]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 (non-flash)
Apr 13 19:30:52 user nova-compute[71692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:30:52 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feba0518b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777'): ({'sdd'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Removing single pathed devices sdd {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e962e06e-2ae4-4bc4-86f6-622bc098fd91]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad11c03-9e5c-4246-a44b-b3ea0a65fbcc]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Flushing IO for device /dev/sdd {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[832771fb-19e6-4570-ba95-346e0026a8cc]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7652dce-f42a-4459-9148-1d03c441bd39]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4604119-22dc-4218-ac3c-de471e41c0f9]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:52 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:53 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a383c1d3-37a1-42fe-894f-5a43cf8f0040]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:53 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777, portal: 172.16.0.220,3260]
Apr 13 19:30:53 user nova-compute[71692]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777, portal: 172.16.0.220,3260] successful.
Apr 13 19:30:53 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:30:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:30:53 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec99b355-2456-4eef-af04-cc75aff66777 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:30:53 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85fbb20-77f0-4e0e-a00b-5b758188eb8a]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:30:53 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:30:53 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:30:53 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] <== disconnect_volume: return (302ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:30:53 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:30:53 user nova-compute[71692]: DEBUG nova.objects.instance [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'flavor' on Instance uuid 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:30:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-85d1b2a4-7176-4151-96c6-aa6c79531104 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.779s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:30:54 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:30:56 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:30:56 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:30:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:30:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:30:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:30:56 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:30:56 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Updating instance_info_cache with network_info: [{"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:30:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-595c2a08-28fd-4076-b7bb-b9b0ac4349e6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:30:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:30:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:30:57 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:30:59 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:31:00 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:31:01 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:31:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:31:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:31:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:31:01 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:31:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:31:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:31:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:31:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:31:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:31:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:31:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:31:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:31:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:31:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:31:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:31:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:31:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:31:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:31:02 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:31:02 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:31:02 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8416MB free_disk=25.905410766601562GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:31:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:31:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:31:02 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:31:02 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:31:02 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:31:02 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:31:02 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:31:02 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:31:02 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:31:02 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:31:02 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:31:03 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:31:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:31:04 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:31:04 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:31:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:31:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:31:07 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:31:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:31:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:31:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:31:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:31:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:31:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:31:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:31:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:31:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:31:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:31:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:31:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:31:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:31:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:31:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:31:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:31:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:31:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:31:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:31:44 user nova-compute[71692]: INFO nova.compute.manager [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Terminating instance
Apr 13 19:31:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:31:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-8b0b3b13-0509-4ccb-b9c2-04fa50445b2a req-e66cf807-34e6-4da3-91c0-352d79d74648 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received event network-vif-unplugged-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:31:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8b0b3b13-0509-4ccb-b9c2-04fa50445b2a req-e66cf807-34e6-4da3-91c0-352d79d74648 service nova] Acquiring lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:31:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8b0b3b13-0509-4ccb-b9c2-04fa50445b2a req-e66cf807-34e6-4da3-91c0-352d79d74648 service nova] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:31:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8b0b3b13-0509-4ccb-b9c2-04fa50445b2a req-e66cf807-34e6-4da3-91c0-352d79d74648 service nova] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:31:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-8b0b3b13-0509-4ccb-b9c2-04fa50445b2a req-e66cf807-34e6-4da3-91c0-352d79d74648 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] No waiting events found dispatching network-vif-unplugged-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:31:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-8b0b3b13-0509-4ccb-b9c2-04fa50445b2a req-e66cf807-34e6-4da3-91c0-352d79d74648 service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received event network-vif-unplugged-18d17551-39ea-401c-95cf-acfdafb210d5 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:31:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:45 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Instance destroyed successfully.
Apr 13 19:31:45 user nova-compute[71692]: DEBUG nova.objects.instance [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'resources' on Instance uuid 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:31:45 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:26:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-304929672',display_name='tempest-TestMinimumBasicScenario-server-304929672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-304929672',id=39,image_ref='dc0ead7b-fade-4a75-ad11-302ad2eb923b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjiNQrMZkLrv/EsYiTKx9Bso1DHqJYptOtxcSQw4ewhiYzdhDtT3eKqKNXIIMToEcZ9WUG6UoWwxRLW6EfnAJANQV8bUtuFoVgIl7T4cD+d2MiwUmR5kNz16P2NI+rGLA==',key_name='tempest-TestMinimumBasicScenario-256533708',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:26:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba0e42217cc44413951d6d5a87dbb886',ramdisk_id='',reservation_id='r-lcu3iow5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dc0ead7b-fade-4a75-ad11-302ad2eb923b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-8202894',owner_user_name='tempest-TestMinimumBasicScenario-8202894-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:29:07Z,user_data=None,user_id='9b9ed2da2b4949269c2df77766a1835f',uuid=595c2a08-28fd-4076-b7bb-b9b0ac4349e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:31:45 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converting VIF {"id": "18d17551-39ea-401c-95cf-acfdafb210d5", "address": "fa:16:3e:7b:d7:6a", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d17551-39", "ovs_interfaceid": "18d17551-39ea-401c-95cf-acfdafb210d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:31:45 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:d7:6a,bridge_name='br-int',has_traffic_filtering=True,id=18d17551-39ea-401c-95cf-acfdafb210d5,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d17551-39') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:31:45 user nova-compute[71692]: DEBUG os_vif [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:d7:6a,bridge_name='br-int',has_traffic_filtering=True,id=18d17551-39ea-401c-95cf-acfdafb210d5,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d17551-39') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:31:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18d17551-39, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:31:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:31:45 user nova-compute[71692]: INFO os_vif [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:d7:6a,bridge_name='br-int',has_traffic_filtering=True,id=18d17551-39ea-401c-95cf-acfdafb210d5,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d17551-39')
Apr 13 19:31:45 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Deleting instance files /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6_del
Apr 13 19:31:45 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Deletion of /opt/stack/data/nova/instances/595c2a08-28fd-4076-b7bb-b9b0ac4349e6_del complete
Apr 13 19:31:45 user nova-compute[71692]: INFO nova.compute.manager [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 13 19:31:45 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:31:45 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:31:45 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:31:45 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:31:46 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Took 0.51 seconds to deallocate network for instance.
Apr 13 19:31:46 user nova-compute[71692]: DEBUG nova.compute.manager [req-7b0c02b7-a383-4377-aca2-c4068b335472 req-28cfcf93-5931-4714-b7e7-7584adbaedbf service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received event network-vif-deleted-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:31:46 user nova-compute[71692]: INFO nova.compute.manager [req-7b0c02b7-a383-4377-aca2-c4068b335472 req-28cfcf93-5931-4714-b7e7-7584adbaedbf service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Neutron deleted interface 18d17551-39ea-401c-95cf-acfdafb210d5; detaching it from the instance and deleting it from the info cache
Apr 13 19:31:46 user nova-compute[71692]: DEBUG nova.network.neutron [req-7b0c02b7-a383-4377-aca2-c4068b335472 req-28cfcf93-5931-4714-b7e7-7584adbaedbf service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:31:46 user nova-compute[71692]: DEBUG nova.compute.manager [req-7b0c02b7-a383-4377-aca2-c4068b335472 req-28cfcf93-5931-4714-b7e7-7584adbaedbf service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Detach interface failed, port_id=18d17551-39ea-401c-95cf-acfdafb210d5, reason: Instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 could not be found. {{(pid=71692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 19:31:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:31:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:31:46 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:31:46 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:31:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:31:46 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Deleted allocations for instance 595c2a08-28fd-4076-b7bb-b9b0ac4349e6
Apr 13 19:31:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-907663aa-3474-450f-a121-77efb6953d39 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.729s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:31:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-dee59bf8-ec0d-4665-b71f-c7e0ac5c5bac req-00e52353-7835-4528-974f-02f0b6ed8e2a service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received event network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:31:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dee59bf8-ec0d-4665-b71f-c7e0ac5c5bac req-00e52353-7835-4528-974f-02f0b6ed8e2a service nova] Acquiring lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:31:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dee59bf8-ec0d-4665-b71f-c7e0ac5c5bac req-00e52353-7835-4528-974f-02f0b6ed8e2a service nova] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:31:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dee59bf8-ec0d-4665-b71f-c7e0ac5c5bac req-00e52353-7835-4528-974f-02f0b6ed8e2a service nova] Lock "595c2a08-28fd-4076-b7bb-b9b0ac4349e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:31:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-dee59bf8-ec0d-4665-b71f-c7e0ac5c5bac req-00e52353-7835-4528-974f-02f0b6ed8e2a service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] No waiting events found dispatching network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:31:47 user nova-compute[71692]: WARNING nova.compute.manager [req-dee59bf8-ec0d-4665-b71f-c7e0ac5c5bac req-00e52353-7835-4528-974f-02f0b6ed8e2a service nova] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Received unexpected event network-vif-plugged-18d17551-39ea-401c-95cf-acfdafb210d5 for instance with vm_state deleted and task_state None.
Apr 13 19:31:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:55 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:31:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:31:58 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:31:58 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:31:58 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 19:31:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:31:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:31:58 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:31:58 user nova-compute[71692]: DEBUG nova.objects.instance [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lazy-loading 'info_cache' on Instance uuid 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:31:58 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updating instance_info_cache with network_info: [{"id": "5bd81344-f669-49c6-897f-97510d86e77b", "address": "fa:16:3e:01:0c:f9", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd81344-f6", "ovs_interfaceid": "5bd81344-f669-49c6-897f-97510d86e77b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:31:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:31:58 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:31:59 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:31:59 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:32:00 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681414305.4015567, 595c2a08-28fd-4076-b7bb-b9b0ac4349e6 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:32:00 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] VM Stopped (Lifecycle Event)
Apr 13 19:32:00 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f35c0221-0217-4768-8e5f-52c32884eb5f None None] [instance: 595c2a08-28fd-4076-b7bb-b9b0ac4349e6] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:32:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:01 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:32:01 user nova-compute[71692]: DEBUG nova.compute.manager [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:32:01 user nova-compute[71692]: INFO nova.compute.manager [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] instance snapshotting
Apr 13 19:32:02 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Beginning live snapshot process
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json -f qcow2 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json -f qcow2" returned: 0 in 0.151s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json -f qcow2 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json -f qcow2" returned: 0 in 0.130s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc2ik8b78/9954bf72d9b843838f4b6fa3bf878824.delta 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc2ik8b78/9954bf72d9b843838f4b6fa3bf878824.delta 1073741824" returned: 0 in 0.050s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:02 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:32:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:32:03 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:32:03 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:32:03 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8542MB free_disk=25.924434661865234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:32:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:32:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:32:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71692) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 19:32:03 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 19:32:03 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:32:03 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:32:03 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:32:03 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance bbd7e115-1fc0-4c57-8ed8-eee343b69800 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:32:03 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:32:03 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:32:03 user nova-compute[71692]: DEBUG nova.privsep.utils [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 19:32:03 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc2ik8b78/9954bf72d9b843838f4b6fa3bf878824.delta /opt/stack/data/nova/instances/snapshots/tmpc2ik8b78/9954bf72d9b843838f4b6fa3bf878824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:03 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:32:03 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:32:03 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:32:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.323s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:32:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc2ik8b78/9954bf72d9b843838f4b6fa3bf878824.delta /opt/stack/data/nova/instances/snapshots/tmpc2ik8b78/9954bf72d9b843838f4b6fa3bf878824" returned: 0 in 0.443s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:04 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Snapshot extracted, beginning image upload
Apr 13 19:32:04 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:32:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:32:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:06 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Snapshot image upload complete
Apr 13 19:32:06 user nova-compute[71692]: INFO nova.compute.manager [None req-044ced33-05e9-4b88-ab71-0a9fcff7cb45 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Took 4.31 seconds to snapshot the instance on the hypervisor.
Apr 13 19:32:07 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:32:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:32:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:32:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:32:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:32:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:32:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:32:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:32:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:32:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:32:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-5aa066e4-5bf7-4e39-ab4b-201f58be5f2b req-df76e7e9-3c06-43ff-bb40-aef694faa59c service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Received event network-changed-78719f53-87de-44f2-b6f3-f2d77851fce0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-5aa066e4-5bf7-4e39-ab4b-201f58be5f2b req-df76e7e9-3c06-43ff-bb40-aef694faa59c service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Refreshing instance network info cache due to event network-changed-78719f53-87de-44f2-b6f3-f2d77851fce0. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5aa066e4-5bf7-4e39-ab4b-201f58be5f2b req-df76e7e9-3c06-43ff-bb40-aef694faa59c service nova] Acquiring lock "refresh_cache-bbd7e115-1fc0-4c57-8ed8-eee343b69800" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5aa066e4-5bf7-4e39-ab4b-201f58be5f2b req-df76e7e9-3c06-43ff-bb40-aef694faa59c service nova] Acquired lock "refresh_cache-bbd7e115-1fc0-4c57-8ed8-eee343b69800" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG nova.network.neutron [req-5aa066e4-5bf7-4e39-ab4b-201f58be5f2b req-df76e7e9-3c06-43ff-bb40-aef694faa59c service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Refreshing network info cache for port 78719f53-87de-44f2-b6f3-f2d77851fce0 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:32:22 user nova-compute[71692]: INFO nova.compute.manager [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Terminating instance
Apr 13 19:32:22 user nova-compute[71692]: DEBUG nova.compute.manager [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG nova.network.neutron [req-5aa066e4-5bf7-4e39-ab4b-201f58be5f2b req-df76e7e9-3c06-43ff-bb40-aef694faa59c service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Updated VIF entry in instance network info cache for port 78719f53-87de-44f2-b6f3-f2d77851fce0. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG nova.network.neutron [req-5aa066e4-5bf7-4e39-ab4b-201f58be5f2b req-df76e7e9-3c06-43ff-bb40-aef694faa59c service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Updating instance_info_cache with network_info: [{"id": "78719f53-87de-44f2-b6f3-f2d77851fce0", "address": "fa:16:3e:a1:24:98", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78719f53-87", "ovs_interfaceid": "78719f53-87de-44f2-b6f3-f2d77851fce0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-97090592-0130-45e0-934d-64d7dfe865a2 req-e0b50da8-e6b2-49b2-8c9d-622e6de7aba4 service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Received event network-vif-unplugged-78719f53-87de-44f2-b6f3-f2d77851fce0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-97090592-0130-45e0-934d-64d7dfe865a2 req-e0b50da8-e6b2-49b2-8c9d-622e6de7aba4 service nova] Acquiring lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-97090592-0130-45e0-934d-64d7dfe865a2 req-e0b50da8-e6b2-49b2-8c9d-622e6de7aba4 service nova] Lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-97090592-0130-45e0-934d-64d7dfe865a2 req-e0b50da8-e6b2-49b2-8c9d-622e6de7aba4 service nova] Lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-97090592-0130-45e0-934d-64d7dfe865a2 req-e0b50da8-e6b2-49b2-8c9d-622e6de7aba4 service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] No waiting events found dispatching network-vif-unplugged-78719f53-87de-44f2-b6f3-f2d77851fce0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-97090592-0130-45e0-934d-64d7dfe865a2 req-e0b50da8-e6b2-49b2-8c9d-622e6de7aba4 service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Received event network-vif-unplugged-78719f53-87de-44f2-b6f3-f2d77851fce0 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5aa066e4-5bf7-4e39-ab4b-201f58be5f2b req-df76e7e9-3c06-43ff-bb40-aef694faa59c service nova] Releasing lock "refresh_cache-bbd7e115-1fc0-4c57-8ed8-eee343b69800" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:32:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:23 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Instance destroyed successfully.
Apr 13 19:32:23 user nova-compute[71692]: DEBUG nova.objects.instance [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lazy-loading 'resources' on Instance uuid bbd7e115-1fc0-4c57-8ed8-eee343b69800 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:30:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-46900522',display_name='tempest-TestVolumeBootPattern-server-46900522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-46900522',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj7TcL9FU0ycuamYqYTfleaq2m4r0SEirSHRlkPBcG/eCMlwnGnrLneKNOsIY4WhqDyz6ZvULFdimsQ4U+9lxxBdfuyuTJJKa1K6nRrg6kFRx2pkuS1DtxEUpZtRdywRA==',key_name='tempest-TestVolumeBootPattern-1410205426',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:30:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-l2oaaddo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:30:41Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=bbd7e115-1fc0-4c57-8ed8-eee343b69800,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78719f53-87de-44f2-b6f3-f2d77851fce0", "address": "fa:16:3e:a1:24:98", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78719f53-87", "ovs_interfaceid": "78719f53-87de-44f2-b6f3-f2d77851fce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "78719f53-87de-44f2-b6f3-f2d77851fce0", "address": "fa:16:3e:a1:24:98", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78719f53-87", "ovs_interfaceid": "78719f53-87de-44f2-b6f3-f2d77851fce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:24:98,bridge_name='br-int',has_traffic_filtering=True,id=78719f53-87de-44f2-b6f3-f2d77851fce0,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78719f53-87') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_vif [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:24:98,bridge_name='br-int',has_traffic_filtering=True,id=78719f53-87de-44f2-b6f3-f2d77851fce0,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78719f53-87') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78719f53-87, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:23 user nova-compute[71692]: INFO os_vif [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:24:98,bridge_name='br-int',has_traffic_filtering=True,id=78719f53-87de-44f2-b6f3-f2d77851fce0,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78719f53-87')
Apr 13 19:32:23 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZFKraEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:32:23 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[72caba07-3568-4201-8785-e8b0b0ffbd0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:32:23 user nova-compute[71692]: No targets found.
Apr 13 19:32:23 user nova-compute[71692]: iSNS:
Apr 13 19:32:23 user nova-compute[71692]: No targets found.
Apr 13 19:32:23 user nova-compute[71692]: STATIC:
Apr 13 19:32:23 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5
Apr 13 19:32:23 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:32:23 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:32:23 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945
Apr 13 19:32:23 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:32:23 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:32:23 user nova-compute[71692]: FIRMWARE:
Apr 13 19:32:23 user nova-compute[71692]: No targets found.
Apr 13 19:32:23 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:32:23 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:32:23 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e0ae31-95b8-45c0-a3a7-177a66d294d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed707ff-9995-4aa7-926b-0b4a99e832b7]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:32:23 user nova-compute[71692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:32:23 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:32:23 user nova-compute[71692]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:32:23 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feba051a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5'): ({'sdc'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Removing single pathed devices sdc {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e8bf0f-68cb-45db-bc19-c5cd34d0849a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc8c5ef-5c6c-4233-af97-4596eb07701f]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flushing IO for device /dev/sdc {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[43774260-0038-4ea7-a009-c025ef79e8e6]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa431dc0-9ccb-46d2-ba6b-d31cc5693b14]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b1aeb4-79a3-4dac-8fd6-151c7e7dba5f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad61027-ed9e-428d-9a10-9c79685b5609]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5, portal: 172.16.0.220,3260]
Apr 13 19:32:23 user nova-compute[71692]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5, portal: 172.16.0.220,3260] successful.
Apr 13 19:32:23 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4797d599-b537-4e0d-962f-306ee8aebab7]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== disconnect_volume: return (303ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:32:23 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Deleting instance files /opt/stack/data/nova/instances/bbd7e115-1fc0-4c57-8ed8-eee343b69800_del
Apr 13 19:32:23 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Deletion of /opt/stack/data/nova/instances/bbd7e115-1fc0-4c57-8ed8-eee343b69800_del complete
Apr 13 19:32:23 user nova-compute[71692]: INFO nova.compute.manager [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 13 19:32:23 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:32:23 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:32:24 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:32:24 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Took 0.72 seconds to deallocate network for instance.
Apr 13 19:32:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-99003ba5-276e-44f7-a48f-165a1ff6880f req-97476278-1b2d-4048-a895-e985a4a3682a service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Received event network-vif-deleted-78719f53-87de-44f2-b6f3-f2d77851fce0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:32:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-193a9137-5f5c-48e2-b1c0-c9c2300f6986 req-c3c92013-5a61-4cc4-bd5f-20d0ea7e4455 service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Received event network-vif-plugged-78719f53-87de-44f2-b6f3-f2d77851fce0 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:32:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-193a9137-5f5c-48e2-b1c0-c9c2300f6986 req-c3c92013-5a61-4cc4-bd5f-20d0ea7e4455 service nova] Acquiring lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:32:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-193a9137-5f5c-48e2-b1c0-c9c2300f6986 req-c3c92013-5a61-4cc4-bd5f-20d0ea7e4455 service nova] Lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:32:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-193a9137-5f5c-48e2-b1c0-c9c2300f6986 req-c3c92013-5a61-4cc4-bd5f-20d0ea7e4455 service nova] Lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:32:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-193a9137-5f5c-48e2-b1c0-c9c2300f6986 req-c3c92013-5a61-4cc4-bd5f-20d0ea7e4455 service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] No waiting events found dispatching network-vif-plugged-78719f53-87de-44f2-b6f3-f2d77851fce0 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:32:24 user nova-compute[71692]: WARNING nova.compute.manager [req-193a9137-5f5c-48e2-b1c0-c9c2300f6986 req-c3c92013-5a61-4cc4-bd5f-20d0ea7e4455 service nova] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Received unexpected event network-vif-plugged-78719f53-87de-44f2-b6f3-f2d77851fce0 for instance with vm_state active and task_state deleting.
Apr 13 19:32:25 user nova-compute[71692]: INFO nova.compute.manager [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Took 0.79 seconds to detach 1 volumes for instance.
Apr 13 19:32:25 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Verify base images {{(pid=71692) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71692) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Image id e5467a4f-b219-48a2-9412-0a7e7ac851c3 yields fingerprint eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 {{(pid=71692) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 13 19:32:25 user nova-compute[71692]: INFO nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] image e5467a4f-b219-48a2-9412-0a7e7ac851c3 at (/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31): checking
Apr 13 19:32:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] image e5467a4f-b219-48a2-9412-0a7e7ac851c3 at (/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31): image is in use {{(pid=71692) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 is a valid instance name {{(pid=71692) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 has a disk file {{(pid=71692) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 is backed by eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 {{(pid=71692) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 is a valid instance name {{(pid=71692) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 has a disk file {{(pid=71692) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 is backed by eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 {{(pid=71692) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] 991871a0-3a4e-4014-b07f-3e8c49eeda5a is a valid instance name {{(pid=71692) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 13 19:32:25 user nova-compute[71692]: WARNING nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb
Apr 13 19:32:25 user nova-compute[71692]: WARNING nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Unknown base file: /opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d
Apr 13 19:32:25 user nova-compute[71692]: WARNING nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209
Apr 13 19:32:25 user nova-compute[71692]: WARNING nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c
Apr 13 19:32:25 user nova-compute[71692]: WARNING nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2
Apr 13 19:32:25 user nova-compute[71692]: WARNING nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ffc8830d176c3c93408bae1a1824785450ad5b4a
Apr 13 19:32:25 user nova-compute[71692]: WARNING nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1594579454ae71dbf7df16d46e500c8fe7614a01
Apr 13 19:32:25 user nova-compute[71692]: INFO nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Active base files: /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31
Apr 13 19:32:25 user nova-compute[71692]: INFO nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Removable base files: /opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb /opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209 /opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c /opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2 /opt/stack/data/nova/instances/_base/ffc8830d176c3c93408bae1a1824785450ad5b4a /opt/stack/data/nova/instances/_base/1594579454ae71dbf7df16d46e500c8fe7614a01
Apr 13 19:32:25 user nova-compute[71692]: INFO nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4ac7883f092fa9c8db44ed7fc999352860be33cb
Apr 13 19:32:25 user nova-compute[71692]: INFO nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/24e8767c09f24c5dc5936d0959fad5c545c0e92d
Apr 13 19:32:25 user nova-compute[71692]: INFO nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8359687d5374c46184ce432418d27607b989e209
Apr 13 19:32:25 user nova-compute[71692]: INFO nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fc7af15914c05ded0f464543e0c8651dbfab425c
Apr 13 19:32:25 user nova-compute[71692]: INFO nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5755f82ac4df8484bcdb94e991d129d0191c42a2
Apr 13 19:32:25 user nova-compute[71692]: INFO nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ffc8830d176c3c93408bae1a1824785450ad5b4a
Apr 13 19:32:25 user nova-compute[71692]: INFO nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1594579454ae71dbf7df16d46e500c8fe7614a01
Apr 13 19:32:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Verification complete {{(pid=71692) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Verify swap images {{(pid=71692) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 13 19:32:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.imagecache [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Verify ephemeral images {{(pid=71692) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 13 19:32:25 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Deleted allocations for instance bbd7e115-1fc0-4c57-8ed8-eee343b69800
Apr 13 19:32:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9157b8d9-f5fe-4f55-a3b1-3df463c18378 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "bbd7e115-1fc0-4c57-8ed8-eee343b69800" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.177s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:32:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "86893da2-3681-4a37-a6fc-1f56a2682070" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "86893da2-3681-4a37-a6fc-1f56a2682070" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681414343.1498628, bbd7e115-1fc0-4c57-8ed8-eee343b69800 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:32:38 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] VM Stopped (Lifecycle Event)
Apr 13 19:32:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-64dd059f-0937-49e6-9cd0-38b20ab38a2b None None] [instance: bbd7e115-1fc0-4c57-8ed8-eee343b69800] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:32:38 user nova-compute[71692]: INFO nova.compute.claims [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Claim successful on node user
Apr 13 19:32:38 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG nova.network.neutron [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:32:38 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:32:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:32:38 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Creating image(s)
Apr 13 19:32:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "/opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "/opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "/opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "a6f9d9fe141426b447adcb2f8b20ce2e6173648f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:32:38 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "a6f9d9fe141426b447adcb2f8b20ce2e6173648f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f9d9fe141426b447adcb2f8b20ce2e6173648f.part --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG nova.policy [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b9ed2da2b4949269c2df77766a1835f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba0e42217cc44413951d6d5a87dbb886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f9d9fe141426b447adcb2f8b20ce2e6173648f.part --force-share --output=json" returned: 0 in 0.127s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG nova.virt.images [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 757ffc78-56f8-4b5c-b83d-33fa99678d59 was qcow2, converting to raw {{(pid=71692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG nova.privsep.utils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a6f9d9fe141426b447adcb2f8b20ce2e6173648f.part /opt/stack/data/nova/instances/_base/a6f9d9fe141426b447adcb2f8b20ce2e6173648f.converted {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a6f9d9fe141426b447adcb2f8b20ce2e6173648f.part /opt/stack/data/nova/instances/_base/a6f9d9fe141426b447adcb2f8b20ce2e6173648f.converted" returned: 0 in 0.124s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f9d9fe141426b447adcb2f8b20ce2e6173648f.converted --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f9d9fe141426b447adcb2f8b20ce2e6173648f.converted --force-share --output=json" returned: 0 in 0.126s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "a6f9d9fe141426b447adcb2f8b20ce2e6173648f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.734s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f9d9fe141426b447adcb2f8b20ce2e6173648f --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f9d9fe141426b447adcb2f8b20ce2e6173648f --force-share --output=json" returned: 0 in 0.126s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "a6f9d9fe141426b447adcb2f8b20ce2e6173648f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "a6f9d9fe141426b447adcb2f8b20ce2e6173648f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f9d9fe141426b447adcb2f8b20ce2e6173648f --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG nova.network.neutron [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Successfully created port: c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f9d9fe141426b447adcb2f8b20ce2e6173648f --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a6f9d9fe141426b447adcb2f8b20ce2e6173648f,backing_fmt=raw /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a6f9d9fe141426b447adcb2f8b20ce2e6173648f,backing_fmt=raw /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk 1073741824" returned: 0 in 0.051s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "a6f9d9fe141426b447adcb2f8b20ce2e6173648f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f9d9fe141426b447adcb2f8b20ce2e6173648f --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6f9d9fe141426b447adcb2f8b20ce2e6173648f --force-share --output=json" returned: 0 in 0.129s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:32:39 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Cannot resize image /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.objects.instance [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'migration_context' on Instance uuid 86893da2-3681-4a37-a6fc-1f56a2682070 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Ensure instance console log exists: /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Successfully updated port: c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquired lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cbb95b91-62f4-4aab-9238-493c0f1fade6 req-8c27fdfe-aeee-40b1-8548-7bb90837265b service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received event network-changed-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-cbb95b91-62f4-4aab-9238-493c0f1fade6 req-8c27fdfe-aeee-40b1-8548-7bb90837265b service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Refreshing instance network info cache due to event network-changed-c940609d-fa89-4382-ad90-bba2f3f551f3. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbb95b91-62f4-4aab-9238-493c0f1fade6 req-8c27fdfe-aeee-40b1-8548-7bb90837265b service nova] Acquiring lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.network.neutron [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Updating instance_info_cache with network_info: [{"id": "c940609d-fa89-4382-ad90-bba2f3f551f3", "address": "fa:16:3e:27:ff:c3", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940609d-fa", "ovs_interfaceid": "c940609d-fa89-4382-ad90-bba2f3f551f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Releasing lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.compute.manager [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Instance network_info: |[{"id": "c940609d-fa89-4382-ad90-bba2f3f551f3", "address": "fa:16:3e:27:ff:c3", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940609d-fa", "ovs_interfaceid": "c940609d-fa89-4382-ad90-bba2f3f551f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbb95b91-62f4-4aab-9238-493c0f1fade6 req-8c27fdfe-aeee-40b1-8548-7bb90837265b service nova] Acquired lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.network.neutron [req-cbb95b91-62f4-4aab-9238-493c0f1fade6 req-8c27fdfe-aeee-40b1-8548-7bb90837265b service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Refreshing network info cache for port c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Start _get_guest_xml network_info=[{"id": "c940609d-fa89-4382-ad90-bba2f3f551f3", "address": "fa:16:3e:27:ff:c3", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940609d-fa", "ovs_interfaceid": "c940609d-fa89-4382-ad90-bba2f3f551f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T19:32:36Z,direct_url=<?>,disk_format='qcow2',id=757ffc78-56f8-4b5c-b83d-33fa99678d59,min_disk=0,min_ram=0,name='tempest-scenario-img--1990242119',owner='ba0e42217cc44413951d6d5a87dbb886',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T19:32:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': '757ffc78-56f8-4b5c-b83d-33fa99678d59'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:32:40 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:32:40 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T19:32:36Z,direct_url=<?>,disk_format='qcow2',id=757ffc78-56f8-4b5c-b83d-33fa99678d59,min_disk=0,min_ram=0,name='tempest-scenario-img--1990242119',owner='ba0e42217cc44413951d6d5a87dbb886',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T19:32:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:32:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1642739098',display_name='tempest-TestMinimumBasicScenario-server-1642739098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1642739098',id=43,image_ref='757ffc78-56f8-4b5c-b83d-33fa99678d59',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwcqpuDDwnFCEHILsu3WkKfw+2MVJkUkNLRq/o7hP6qLuVniwQ8/8OV7G92m5CXMJVOwwdyf9OuSgpmCn7j4zLzXlUPSwq2Fys9p4c7O5dwLlZB/zevuX8VkzU1GXk55A==',key_name='tempest-TestMinimumBasicScenario-717246144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba0e42217cc44413951d6d5a87dbb886',ramdisk_id='',reservation_id='r-5jbkdfgi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='757ffc78-56f8-4b5c-b83d-33fa99678d59',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-8202894',owner_user_name='tempest-TestMinimumBasicScenario-8202894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:32:39Z,user_data=None,user_id='9b9ed2da2b4949269c2df77766a1835f',uuid=86893da2-3681-4a37-a6fc-1f56a2682070,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c940609d-fa89-4382-ad90-bba2f3f551f3", "address": "fa:16:3e:27:ff:c3", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940609d-fa", "ovs_interfaceid": "c940609d-fa89-4382-ad90-bba2f3f551f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converting VIF {"id": "c940609d-fa89-4382-ad90-bba2f3f551f3", "address": "fa:16:3e:27:ff:c3", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940609d-fa", "ovs_interfaceid": "c940609d-fa89-4382-ad90-bba2f3f551f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=c940609d-fa89-4382-ad90-bba2f3f551f3,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc940609d-fa') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.objects.instance [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'pci_devices' on Instance uuid 86893da2-3681-4a37-a6fc-1f56a2682070 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:32:40 user nova-compute[71692]:   <uuid>86893da2-3681-4a37-a6fc-1f56a2682070</uuid>
Apr 13 19:32:40 user nova-compute[71692]:   <name>instance-0000002b</name>
Apr 13 19:32:40 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:32:40 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:32:40 user nova-compute[71692]:   <metadata>
Apr 13 19:32:40 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:32:40 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:32:40 user nova-compute[71692]:       <nova:name>tempest-TestMinimumBasicScenario-server-1642739098</nova:name>
Apr 13 19:32:40 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:32:40</nova:creationTime>
Apr 13 19:32:40 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:32:40 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:32:40 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:32:40 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:32:40 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:32:40 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:32:40 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:32:40 user nova-compute[71692]:       <nova:owner>
Apr 13 19:32:40 user nova-compute[71692]:         <nova:user uuid="9b9ed2da2b4949269c2df77766a1835f">tempest-TestMinimumBasicScenario-8202894-project-member</nova:user>
Apr 13 19:32:40 user nova-compute[71692]:         <nova:project uuid="ba0e42217cc44413951d6d5a87dbb886">tempest-TestMinimumBasicScenario-8202894</nova:project>
Apr 13 19:32:40 user nova-compute[71692]:       </nova:owner>
Apr 13 19:32:40 user nova-compute[71692]:       <nova:root type="image" uuid="757ffc78-56f8-4b5c-b83d-33fa99678d59"/>
Apr 13 19:32:40 user nova-compute[71692]:       <nova:ports>
Apr 13 19:32:40 user nova-compute[71692]:         <nova:port uuid="c940609d-fa89-4382-ad90-bba2f3f551f3">
Apr 13 19:32:40 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 19:32:40 user nova-compute[71692]:         </nova:port>
Apr 13 19:32:40 user nova-compute[71692]:       </nova:ports>
Apr 13 19:32:40 user nova-compute[71692]:     </nova:instance>
Apr 13 19:32:40 user nova-compute[71692]:   </metadata>
Apr 13 19:32:40 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:32:40 user nova-compute[71692]:     <system>
Apr 13 19:32:40 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:32:40 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:32:40 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:32:40 user nova-compute[71692]:       <entry name="serial">86893da2-3681-4a37-a6fc-1f56a2682070</entry>
Apr 13 19:32:40 user nova-compute[71692]:       <entry name="uuid">86893da2-3681-4a37-a6fc-1f56a2682070</entry>
Apr 13 19:32:40 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:32:40 user nova-compute[71692]:     </system>
Apr 13 19:32:40 user nova-compute[71692]:   </sysinfo>
Apr 13 19:32:40 user nova-compute[71692]:   <os>
Apr 13 19:32:40 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:32:40 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:32:40 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:32:40 user nova-compute[71692]:   </os>
Apr 13 19:32:40 user nova-compute[71692]:   <features>
Apr 13 19:32:40 user nova-compute[71692]:     <acpi/>
Apr 13 19:32:40 user nova-compute[71692]:     <apic/>
Apr 13 19:32:40 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:32:40 user nova-compute[71692]:   </features>
Apr 13 19:32:40 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:32:40 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:32:40 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:32:40 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:32:40 user nova-compute[71692]:   </clock>
Apr 13 19:32:40 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:32:40 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:32:40 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:32:40 user nova-compute[71692]:   </cpu>
Apr 13 19:32:40 user nova-compute[71692]:   <devices>
Apr 13 19:32:40 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:32:40 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:32:40 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk"/>
Apr 13 19:32:40 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:32:40 user nova-compute[71692]:     </disk>
Apr 13 19:32:40 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:32:40 user nova-compute[71692]:       <mac address="fa:16:3e:27:ff:c3"/>
Apr 13 19:32:40 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:32:40 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:32:40 user nova-compute[71692]:       <target dev="tapc940609d-fa"/>
Apr 13 19:32:40 user nova-compute[71692]:     </interface>
Apr 13 19:32:40 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:32:40 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/console.log" append="off"/>
Apr 13 19:32:40 user nova-compute[71692]:     </serial>
Apr 13 19:32:40 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:32:40 user nova-compute[71692]:     <video>
Apr 13 19:32:40 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:32:40 user nova-compute[71692]:     </video>
Apr 13 19:32:40 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:32:40 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:32:40 user nova-compute[71692]:     </rng>
Apr 13 19:32:40 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:32:40 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:32:40 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:32:40 user nova-compute[71692]:     </memballoon>
Apr 13 19:32:40 user nova-compute[71692]:   </devices>
Apr 13 19:32:40 user nova-compute[71692]: </domain>
Apr 13 19:32:40 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:32:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1642739098',display_name='tempest-TestMinimumBasicScenario-server-1642739098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1642739098',id=43,image_ref='757ffc78-56f8-4b5c-b83d-33fa99678d59',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwcqpuDDwnFCEHILsu3WkKfw+2MVJkUkNLRq/o7hP6qLuVniwQ8/8OV7G92m5CXMJVOwwdyf9OuSgpmCn7j4zLzXlUPSwq2Fys9p4c7O5dwLlZB/zevuX8VkzU1GXk55A==',key_name='tempest-TestMinimumBasicScenario-717246144',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba0e42217cc44413951d6d5a87dbb886',ramdisk_id='',reservation_id='r-5jbkdfgi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='757ffc78-56f8-4b5c-b83d-33fa99678d59',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-8202894',owner_user_name='tempest-TestMinimumBasicScenario-8202894-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:32:39Z,user_data=None,user_id='9b9ed2da2b4949269c2df77766a1835f',uuid=86893da2-3681-4a37-a6fc-1f56a2682070,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c940609d-fa89-4382-ad90-bba2f3f551f3", "address": "fa:16:3e:27:ff:c3", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940609d-fa", "ovs_interfaceid": "c940609d-fa89-4382-ad90-bba2f3f551f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converting VIF {"id": "c940609d-fa89-4382-ad90-bba2f3f551f3", "address": "fa:16:3e:27:ff:c3", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940609d-fa", "ovs_interfaceid": "c940609d-fa89-4382-ad90-bba2f3f551f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=c940609d-fa89-4382-ad90-bba2f3f551f3,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc940609d-fa') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG os_vif [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=c940609d-fa89-4382-ad90-bba2f3f551f3,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc940609d-fa') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc940609d-fa, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc940609d-fa, col_values=(('external_ids', {'iface-id': 'c940609d-fa89-4382-ad90-bba2f3f551f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:ff:c3', 'vm-uuid': '86893da2-3681-4a37-a6fc-1f56a2682070'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:40 user nova-compute[71692]: INFO os_vif [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=c940609d-fa89-4382-ad90-bba2f3f551f3,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc940609d-fa')
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:32:40 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] No VIF found with MAC fa:16:3e:27:ff:c3, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:32:41 user nova-compute[71692]: DEBUG nova.network.neutron [req-cbb95b91-62f4-4aab-9238-493c0f1fade6 req-8c27fdfe-aeee-40b1-8548-7bb90837265b service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Updated VIF entry in instance network info cache for port c940609d-fa89-4382-ad90-bba2f3f551f3. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:32:41 user nova-compute[71692]: DEBUG nova.network.neutron [req-cbb95b91-62f4-4aab-9238-493c0f1fade6 req-8c27fdfe-aeee-40b1-8548-7bb90837265b service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Updating instance_info_cache with network_info: [{"id": "c940609d-fa89-4382-ad90-bba2f3f551f3", "address": "fa:16:3e:27:ff:c3", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940609d-fa", "ovs_interfaceid": "c940609d-fa89-4382-ad90-bba2f3f551f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:32:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-cbb95b91-62f4-4aab-9238-493c0f1fade6 req-8c27fdfe-aeee-40b1-8548-7bb90837265b service nova] Releasing lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:32:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-5b6dc080-d80d-4bab-b147-f0b1014bca8c req-cc32f9ba-fd39-46e0-99ff-bede2cc7b467 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received event network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:32:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5b6dc080-d80d-4bab-b147-f0b1014bca8c req-cc32f9ba-fd39-46e0-99ff-bede2cc7b467 service nova] Acquiring lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:32:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5b6dc080-d80d-4bab-b147-f0b1014bca8c req-cc32f9ba-fd39-46e0-99ff-bede2cc7b467 service nova] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:32:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-5b6dc080-d80d-4bab-b147-f0b1014bca8c req-cc32f9ba-fd39-46e0-99ff-bede2cc7b467 service nova] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:32:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-5b6dc080-d80d-4bab-b147-f0b1014bca8c req-cc32f9ba-fd39-46e0-99ff-bede2cc7b467 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] No waiting events found dispatching network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:32:42 user nova-compute[71692]: WARNING nova.compute.manager [req-5b6dc080-d80d-4bab-b147-f0b1014bca8c req-cc32f9ba-fd39-46e0-99ff-bede2cc7b467 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received unexpected event network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 for instance with vm_state building and task_state spawning.
Apr 13 19:32:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414364.4444108, 86893da2-3681-4a37-a6fc-1f56a2682070 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:32:44 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] VM Resumed (Lifecycle Event)
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:32:44 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Instance spawned successfully.
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:32:44 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414364.448816, 86893da2-3681-4a37-a6fc-1f56a2682070 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:32:44 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] VM Started (Lifecycle Event)
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:32:44 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:32:44 user nova-compute[71692]: INFO nova.compute.manager [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Took 5.81 seconds to spawn the instance on the hypervisor.
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.compute.manager [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-e573d677-381b-4b31-853d-3c63b051dff2 req-05a4551f-9694-4b19-8ceb-55565a736ee8 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received event network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:32:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e573d677-381b-4b31-853d-3c63b051dff2 req-05a4551f-9694-4b19-8ceb-55565a736ee8 service nova] Acquiring lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:32:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e573d677-381b-4b31-853d-3c63b051dff2 req-05a4551f-9694-4b19-8ceb-55565a736ee8 service nova] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:32:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-e573d677-381b-4b31-853d-3c63b051dff2 req-05a4551f-9694-4b19-8ceb-55565a736ee8 service nova] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:32:44 user nova-compute[71692]: DEBUG nova.compute.manager [req-e573d677-381b-4b31-853d-3c63b051dff2 req-05a4551f-9694-4b19-8ceb-55565a736ee8 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] No waiting events found dispatching network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:32:44 user nova-compute[71692]: WARNING nova.compute.manager [req-e573d677-381b-4b31-853d-3c63b051dff2 req-05a4551f-9694-4b19-8ceb-55565a736ee8 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received unexpected event network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 for instance with vm_state building and task_state spawning.
Apr 13 19:32:44 user nova-compute[71692]: INFO nova.compute.manager [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Took 6.42 seconds to build instance.
Apr 13 19:32:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-48923159-163c-42c4-aad3-6c67976db075 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "86893da2-3681-4a37-a6fc-1f56a2682070" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.515s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:32:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:32:57 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:32:59 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:32:59 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:33:00 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:33:00 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:33:00 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:33:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:33:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:33:00 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:33:00 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Updating instance_info_cache with network_info: [{"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:33:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:33:00 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:33:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:02 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:33:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:03 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:33:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 19:33:04 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:33:04 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:33:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:33:04 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:33:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:33:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:33:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:33:04 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:33:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:33:05 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:33:05 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:33:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8499MB free_disk=25.850563049316406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 86893da2-3681-4a37-a6fc-1f56a2682070 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing inventories for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating ProviderTree inventory for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating inventory in ProviderTree for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing aggregate associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, aggregates: None {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing trait associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:33:05 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:33:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:33:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:33:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:33:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:33:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:33:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:33:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:33:08 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:33:08 user nova-compute[71692]: INFO nova.compute.claims [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Claim successful on node user
Apr 13 19:33:08 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:33:08 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:33:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:33:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:33:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:33:08 user nova-compute[71692]: DEBUG nova.network.neutron [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:33:09 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:33:09 user nova-compute[71692]: DEBUG nova.compute.manager [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:33:09 user nova-compute[71692]: INFO nova.virt.block_device [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Booting with volume-backed-image e5467a4f-b219-48a2-9412-0a7e7ac851c3 at /dev/vda
Apr 13 19:33:09 user nova-compute[71692]: DEBUG nova.policy [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd604fa4d17b42b1abea8c2f2405b58d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c00a7fcd6d3040e8b2db0448eeda93ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:33:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:09 user nova-compute[71692]: DEBUG nova.network.neutron [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Successfully created port: 7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:33:10 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:33:10 user nova-compute[71692]: DEBUG nova.network.neutron [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Successfully updated port: 7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:33:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "refresh_cache-f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:33:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquired lock "refresh_cache-f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:33:10 user nova-compute[71692]: DEBUG nova.network.neutron [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:33:10 user nova-compute[71692]: DEBUG nova.compute.manager [req-4bd2eac0-4bbc-4fc1-8b28-b3894517e979 req-6faa9aa7-28af-49ef-9836-8e8839ea37e4 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received event network-changed-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:33:10 user nova-compute[71692]: DEBUG nova.compute.manager [req-4bd2eac0-4bbc-4fc1-8b28-b3894517e979 req-6faa9aa7-28af-49ef-9836-8e8839ea37e4 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Refreshing instance network info cache due to event network-changed-7d634c23-9eff-4a07-8036-b5ddc748828e. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:33:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bd2eac0-4bbc-4fc1-8b28-b3894517e979 req-6faa9aa7-28af-49ef-9836-8e8839ea37e4 service nova] Acquiring lock "refresh_cache-f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:33:10 user nova-compute[71692]: DEBUG nova.network.neutron [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:33:10 user nova-compute[71692]: DEBUG nova.network.neutron [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Updating instance_info_cache with network_info: [{"id": "7d634c23-9eff-4a07-8036-b5ddc748828e", "address": "fa:16:3e:99:28:62", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d634c23-9e", "ovs_interfaceid": "7d634c23-9eff-4a07-8036-b5ddc748828e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:33:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Releasing lock "refresh_cache-f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:33:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Instance network_info: |[{"id": "7d634c23-9eff-4a07-8036-b5ddc748828e", "address": "fa:16:3e:99:28:62", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d634c23-9e", "ovs_interfaceid": "7d634c23-9eff-4a07-8036-b5ddc748828e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:33:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bd2eac0-4bbc-4fc1-8b28-b3894517e979 req-6faa9aa7-28af-49ef-9836-8e8839ea37e4 service nova] Acquired lock "refresh_cache-f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:33:10 user nova-compute[71692]: DEBUG nova.network.neutron [req-4bd2eac0-4bbc-4fc1-8b28-b3894517e979 req-6faa9aa7-28af-49ef-9836-8e8839ea37e4 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Refreshing network info cache for port 7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:33:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:11 user nova-compute[71692]: DEBUG nova.network.neutron [req-4bd2eac0-4bbc-4fc1-8b28-b3894517e979 req-6faa9aa7-28af-49ef-9836-8e8839ea37e4 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Updated VIF entry in instance network info cache for port 7d634c23-9eff-4a07-8036-b5ddc748828e. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:33:11 user nova-compute[71692]: DEBUG nova.network.neutron [req-4bd2eac0-4bbc-4fc1-8b28-b3894517e979 req-6faa9aa7-28af-49ef-9836-8e8839ea37e4 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Updating instance_info_cache with network_info: [{"id": "7d634c23-9eff-4a07-8036-b5ddc748828e", "address": "fa:16:3e:99:28:62", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d634c23-9e", "ovs_interfaceid": "7d634c23-9eff-4a07-8036-b5ddc748828e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:33:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4bd2eac0-4bbc-4fc1-8b28-b3894517e979 req-6faa9aa7-28af-49ef-9836-8e8839ea37e4 service nova] Releasing lock "refresh_cache-f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:33:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:13 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:33:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:33:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:33:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:33:14 user nova-compute[71692]: INFO nova.compute.claims [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Claim successful on node user
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] There are 0 instances to clean {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG nova.network.neutron [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:33:14 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:33:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:33:14 user nova-compute[71692]: INFO nova.virt.block_device [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Booting with volume 859d56a6-4c86-402c-9b6c-564c027c53d5 at /dev/vda
Apr 13 19:33:14 user nova-compute[71692]: DEBUG nova.policy [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG os_brick.utils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dad0b2e-bd05-42c1-b6ff-78d4f87a998c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1f8f2a-23ba-4506-847c-acc3af8441fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3721c727-4c38-49d2-9e97-fea97dddbe95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[26507ecd-99e3-4605-8574-f6df6f9fd6dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:33:14 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dacaec5-881f-48f4-8d6b-64c6a8e5a72d]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG os_brick.utils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Updating existing volume attachment record: 553aed6e-eca2-4f6e-97cd-a7e8651333eb {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG os_brick.utils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6681f26c-bb2f-4ce2-bbeb-f878f4d4ef0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecee87e-4371-4b39-8c37-f178f6fcef71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f229fb-e792-429b-9c9c-b5e99f98251f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b1c550-ce0a-4016-b1ca-5a3b551535e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:33:14 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:33:14 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a55b780-2ff0-466f-afdd-506bb09139f3]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG os_brick.utils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:33:14 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Updating existing volume attachment record: e8796bab-4e5f-4657-80cb-f821812f0ba4 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:33:15 user nova-compute[71692]: DEBUG nova.network.neutron [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Successfully created port: 35ecb629-90f6-4af1-b1fa-042bfb0cba8d {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:33:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:16 user nova-compute[71692]: DEBUG nova.network.neutron [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Successfully updated port: 35ecb629-90f6-4af1-b1fa-042bfb0cba8d {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:33:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "refresh_cache-f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:33:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquired lock "refresh_cache-f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:33:16 user nova-compute[71692]: DEBUG nova.network.neutron [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:33:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-148e73cf-ab5b-46e1-90fd-c6bf7d2ee974 req-f9a48493-d997-466f-83b3-5981af7befd3 service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Received event network-changed-35ecb629-90f6-4af1-b1fa-042bfb0cba8d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:33:16 user nova-compute[71692]: DEBUG nova.compute.manager [req-148e73cf-ab5b-46e1-90fd-c6bf7d2ee974 req-f9a48493-d997-466f-83b3-5981af7befd3 service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Refreshing instance network info cache due to event network-changed-35ecb629-90f6-4af1-b1fa-042bfb0cba8d. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:33:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-148e73cf-ab5b-46e1-90fd-c6bf7d2ee974 req-f9a48493-d997-466f-83b3-5981af7befd3 service nova] Acquiring lock "refresh_cache-f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:33:16 user nova-compute[71692]: DEBUG nova.network.neutron [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:33:16 user nova-compute[71692]: DEBUG nova.network.neutron [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Updating instance_info_cache with network_info: [{"id": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "address": "fa:16:3e:99:96:34", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ecb629-90", "ovs_interfaceid": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:33:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Releasing lock "refresh_cache-f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:33:16 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Instance network_info: |[{"id": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "address": "fa:16:3e:99:96:34", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ecb629-90", "ovs_interfaceid": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:33:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-148e73cf-ab5b-46e1-90fd-c6bf7d2ee974 req-f9a48493-d997-466f-83b3-5981af7befd3 service nova] Acquired lock "refresh_cache-f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:33:16 user nova-compute[71692]: DEBUG nova.network.neutron [req-148e73cf-ab5b-46e1-90fd-c6bf7d2ee974 req-f9a48493-d997-466f-83b3-5981af7befd3 service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Refreshing network info cache for port 35ecb629-90f6-4af1-b1fa-042bfb0cba8d {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:33:16 user nova-compute[71692]: DEBUG nova.network.neutron [req-148e73cf-ab5b-46e1-90fd-c6bf7d2ee974 req-f9a48493-d997-466f-83b3-5981af7befd3 service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Updated VIF entry in instance network info cache for port 35ecb629-90f6-4af1-b1fa-042bfb0cba8d. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:33:16 user nova-compute[71692]: DEBUG nova.network.neutron [req-148e73cf-ab5b-46e1-90fd-c6bf7d2ee974 req-f9a48493-d997-466f-83b3-5981af7befd3 service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Updating instance_info_cache with network_info: [{"id": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "address": "fa:16:3e:99:96:34", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ecb629-90", "ovs_interfaceid": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:33:16 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-148e73cf-ab5b-46e1-90fd-c6bf7d2ee974 req-f9a48493-d997-466f-83b3-5981af7befd3 service nova] Releasing lock "refresh_cache-f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.compute.manager [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:33:19 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Creating image(s)
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Did not create local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Ensure instance console log exists: /opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Start _get_guest_xml network_info=[{"id": "7d634c23-9eff-4a07-8036-b5ddc748828e", "address": "fa:16:3e:99:28:62", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d634c23-9e", "ovs_interfaceid": "7d634c23-9eff-4a07-8036-b5ddc748828e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'e8796bab-4e5f-4657-80cb-f821812f0ba4', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgbNGHKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76', 'attached_at': '', 'detached_at': '', 'volume_id': '06e23084-c70b-425b-bd8a-e524d1f48258', 'serial': '06e23084-c70b-425b-bd8a-e524d1f48258'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:33:19 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Creating image(s)
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Did not create local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Ensure instance console log exists: /opt/stack/data/nova/instances/f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Start _get_guest_xml network_info=[{"id": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "address": "fa:16:3e:99:96:34", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ecb629-90", "ovs_interfaceid": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': '553aed6e-eca2-4f6e-97cd-a7e8651333eb', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZFKraEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c', 'attached_at': '', 'detached_at': '', 'volume_id': '859d56a6-4c86-402c-9b6c-564c027c53d5', 'serial': '859d56a6-4c86-402c-9b6c-564c027c53d5'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:33:19 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:33:19 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgbNGHKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:33:19 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:33:19 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:33:19 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:33:19 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:33:19 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZFKraEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:33:19 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd752006-ce47-4dd1-9f7d-56994cecafff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:33:19 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5975f33-cafb-4179-a11f-a8c8ab6653d2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258] added
Apr 13 19:33:19 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2adba2-d4e9-4792-8160-3978c87a9c9f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1be8635-01ee-4c61-adf7-72cc8bdb1c0d]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgbNGHKr {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgbNGHKr" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd16ffd-c687-4113-a168-28e339961aad]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pgbNGHKr'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dc4b61-aa2d-4be0-bc87-f3e66fa23957]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[494b9069-a3ad-4bf2-be6f-259fce14df90]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:33:19 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:33:19 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8190d0a6-5566-4770-8a0a-67bb6e055196]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258, portal: 172.16.0.220,3260]
Apr 13 19:33:19 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258, portal: 172.16.0.220,3260] successful.
Apr 13 19:33:19 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8338809a-1c27-4eb1-9f3c-efc6546bad01]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9df9bd1-ce05-4511-b64f-9c0880791c21]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:33:19 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:33:19 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:33:19 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:33:19 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df0e85a-8868-4c8f-877e-3b08161c8c83]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:19 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgbNGHKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23030656664653764', 'path': '/dev/sdc'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030656664653764', 'path': '/dev/sdc'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.261s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:33:20 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:33:20 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[79eb8b1e-3eee-4cd3-a814-9acdd85f39ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:33:20 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-613518771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-613518771',id=44,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c00a7fcd6d3040e8b2db0448eeda93ad',ramdisk_id='',reservation_id='r-acdbcv8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:33:09Z,user_data=None,user_id='dd604fa4d17b42b1abea8c2f2405b58d',uuid=f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d634c23-9eff-4a07-8036-b5ddc748828e", "address": "fa:16:3e:99:28:62", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d634c23-9e", "ovs_interfaceid": "7d634c23-9eff-4a07-8036-b5ddc748828e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converting VIF {"id": "7d634c23-9eff-4a07-8036-b5ddc748828e", "address": "fa:16:3e:99:28:62", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d634c23-9e", "ovs_interfaceid": "7d634c23-9eff-4a07-8036-b5ddc748828e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:28:62,bridge_name='br-int',has_traffic_filtering=True,id=7d634c23-9eff-4a07-8036-b5ddc748828e,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d634c23-9e') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG nova.objects.instance [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'pci_devices' on Instance uuid f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:33:20 user nova-compute[71692]:   <uuid>f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76</uuid>
Apr 13 19:33:20 user nova-compute[71692]:   <name>instance-0000002c</name>
Apr 13 19:33:20 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:33:20 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:33:20 user nova-compute[71692]:   <metadata>
Apr 13 19:33:20 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:33:20 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:33:20 user nova-compute[71692]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-613518771</nova:name>
Apr 13 19:33:20 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:33:19</nova:creationTime>
Apr 13 19:33:20 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:33:20 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:33:20 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:33:20 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:33:20 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:33:20 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:33:20 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:33:20 user nova-compute[71692]:       <nova:owner>
Apr 13 19:33:20 user nova-compute[71692]:         <nova:user uuid="dd604fa4d17b42b1abea8c2f2405b58d">tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member</nova:user>
Apr 13 19:33:20 user nova-compute[71692]:         <nova:project uuid="c00a7fcd6d3040e8b2db0448eeda93ad">tempest-ServerBootFromVolumeStableRescueTest-1051313256</nova:project>
Apr 13 19:33:20 user nova-compute[71692]:       </nova:owner>
Apr 13 19:33:20 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:33:20 user nova-compute[71692]:       <nova:ports>
Apr 13 19:33:20 user nova-compute[71692]:         <nova:port uuid="7d634c23-9eff-4a07-8036-b5ddc748828e">
Apr 13 19:33:20 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 19:33:20 user nova-compute[71692]:         </nova:port>
Apr 13 19:33:20 user nova-compute[71692]:       </nova:ports>
Apr 13 19:33:20 user nova-compute[71692]:     </nova:instance>
Apr 13 19:33:20 user nova-compute[71692]:   </metadata>
Apr 13 19:33:20 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:33:20 user nova-compute[71692]:     <system>
Apr 13 19:33:20 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:33:20 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:33:20 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:33:20 user nova-compute[71692]:       <entry name="serial">f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76</entry>
Apr 13 19:33:20 user nova-compute[71692]:       <entry name="uuid">f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76</entry>
Apr 13 19:33:20 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:33:20 user nova-compute[71692]:     </system>
Apr 13 19:33:20 user nova-compute[71692]:   </sysinfo>
Apr 13 19:33:20 user nova-compute[71692]:   <os>
Apr 13 19:33:20 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:33:20 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:33:20 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:33:20 user nova-compute[71692]:   </os>
Apr 13 19:33:20 user nova-compute[71692]:   <features>
Apr 13 19:33:20 user nova-compute[71692]:     <acpi/>
Apr 13 19:33:20 user nova-compute[71692]:     <apic/>
Apr 13 19:33:20 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:33:20 user nova-compute[71692]:   </features>
Apr 13 19:33:20 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:33:20 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:33:20 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:33:20 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:33:20 user nova-compute[71692]:   </clock>
Apr 13 19:33:20 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:33:20 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:33:20 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:33:20 user nova-compute[71692]:   </cpu>
Apr 13 19:33:20 user nova-compute[71692]:   <devices>
Apr 13 19:33:20 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:33:20 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:33:20 user nova-compute[71692]:       <source dev="/dev/sdc"/>
Apr 13 19:33:20 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:33:20 user nova-compute[71692]:       <serial>06e23084-c70b-425b-bd8a-e524d1f48258</serial>
Apr 13 19:33:20 user nova-compute[71692]:     </disk>
Apr 13 19:33:20 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:33:20 user nova-compute[71692]:       <mac address="fa:16:3e:99:28:62"/>
Apr 13 19:33:20 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:33:20 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:33:20 user nova-compute[71692]:       <target dev="tap7d634c23-9e"/>
Apr 13 19:33:20 user nova-compute[71692]:     </interface>
Apr 13 19:33:20 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:33:20 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/console.log" append="off"/>
Apr 13 19:33:20 user nova-compute[71692]:     </serial>
Apr 13 19:33:20 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:33:20 user nova-compute[71692]:     <video>
Apr 13 19:33:20 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:33:20 user nova-compute[71692]:     </video>
Apr 13 19:33:20 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:33:20 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:33:20 user nova-compute[71692]:     </rng>
Apr 13 19:33:20 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:33:20 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:33:20 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:33:20 user nova-compute[71692]:     </memballoon>
Apr 13 19:33:20 user nova-compute[71692]:   </devices>
Apr 13 19:33:20 user nova-compute[71692]: </domain>
Apr 13 19:33:20 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-613518771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-613518771',id=44,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c00a7fcd6d3040e8b2db0448eeda93ad',ramdisk_id='',reservation_id='r-acdbcv8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:33:09Z,user_data=None,user_id='dd604fa4d17b42b1abea8c2f2405b58d',uuid=f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d634c23-9eff-4a07-8036-b5ddc748828e", "address": "fa:16:3e:99:28:62", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d634c23-9e", "ovs_interfaceid": "7d634c23-9eff-4a07-8036-b5ddc748828e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converting VIF {"id": "7d634c23-9eff-4a07-8036-b5ddc748828e", "address": "fa:16:3e:99:28:62", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d634c23-9e", "ovs_interfaceid": "7d634c23-9eff-4a07-8036-b5ddc748828e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:28:62,bridge_name='br-int',has_traffic_filtering=True,id=7d634c23-9eff-4a07-8036-b5ddc748828e,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d634c23-9e') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_vif [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:28:62,bridge_name='br-int',has_traffic_filtering=True,id=7d634c23-9eff-4a07-8036-b5ddc748828e,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d634c23-9e') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[69023061-651a-46fd-8e0e-966dcfd26303]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5] added
Apr 13 19:33:20 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d634c23-9e, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7d634c23-9e, col_values=(('external_ids', {'iface-id': '7d634c23-9eff-4a07-8036-b5ddc748828e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:28:62', 'vm-uuid': 'f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:20 user nova-compute[71692]: INFO os_vif [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:28:62,bridge_name='br-int',has_traffic_filtering=True,id=7d634c23-9eff-4a07-8036-b5ddc748828e,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d634c23-9e')
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9ec76f-ed4f-4228-b606-bdee68d327f1]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8e7adc-504a-4f18-b3e7-83d33fd53ded]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qZFKraEx {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qZFKraEx" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47828e4-15e3-4e75-a156-ed103556e561]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qZFKraEx'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] No VIF found with MAC fa:16:3e:99:28:62, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[77076451-3ee2-48df-a3ad-b0f13642b79f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87f3d6c-a416-44a8-890f-a751fc9750e7]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:33:20 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:33:20 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:33:20 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:33:20 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d11bad0-45ab-4aa3-ba8a-4d242bbf17d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5, portal: 172.16.0.220,3260]
Apr 13 19:33:20 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5, portal: 172.16.0.220,3260] successful.
Apr 13 19:33:20 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[319d8ae5-354f-4892-b661-c23b33e2e106]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[79efb1ee-4f36-41d1-99b4-54af3bcfa70b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:33:20 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:33:20 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:33:20 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:33:20 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:33:20 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:33:20 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f74d6e5-36c4-48e0-846b-bbcec0c09909]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:33:20 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:33:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:21 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:33:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZFKraEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:33:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:33:21 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== connect_volume: return (2576ms) {'type': 'block', 'scsi_wwn': '23665666335633461', 'path': '/dev/sdd'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:33:21 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665666335633461', 'path': '/dev/sdd'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1195708667',display_name='tempest-TestVolumeBootPattern-server-1195708667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1195708667',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj7TcL9FU0ycuamYqYTfleaq2m4r0SEirSHRlkPBcG/eCMlwnGnrLneKNOsIY4WhqDyz6ZvULFdimsQ4U+9lxxBdfuyuTJJKa1K6nRrg6kFRx2pkuS1DtxEUpZtRdywRA==',key_name='tempest-TestVolumeBootPattern-1410205426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-bgkdcv4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:33:15Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "address": "fa:16:3e:99:96:34", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ecb629-90", "ovs_interfaceid": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "address": "fa:16:3e:99:96:34", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ecb629-90", "ovs_interfaceid": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:96:34,bridge_name='br-int',has_traffic_filtering=True,id=35ecb629-90f6-4af1-b1fa-042bfb0cba8d,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ecb629-90') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lazy-loading 'pci_devices' on Instance uuid f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:33:22 user nova-compute[71692]:   <uuid>f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c</uuid>
Apr 13 19:33:22 user nova-compute[71692]:   <name>instance-0000002d</name>
Apr 13 19:33:22 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:33:22 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:33:22 user nova-compute[71692]:   <metadata>
Apr 13 19:33:22 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:33:22 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:33:22 user nova-compute[71692]:       <nova:name>tempest-TestVolumeBootPattern-server-1195708667</nova:name>
Apr 13 19:33:22 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:33:19</nova:creationTime>
Apr 13 19:33:22 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:33:22 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:33:22 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:33:22 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:33:22 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:33:22 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:33:22 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:33:22 user nova-compute[71692]:       <nova:owner>
Apr 13 19:33:22 user nova-compute[71692]:         <nova:user uuid="526d9c809b81418d89da662f973a1bdc">tempest-TestVolumeBootPattern-1717000141-project-member</nova:user>
Apr 13 19:33:22 user nova-compute[71692]:         <nova:project uuid="a5231d999e51417ebe91927707bfd2bd">tempest-TestVolumeBootPattern-1717000141</nova:project>
Apr 13 19:33:22 user nova-compute[71692]:       </nova:owner>
Apr 13 19:33:22 user nova-compute[71692]:       <nova:ports>
Apr 13 19:33:22 user nova-compute[71692]:         <nova:port uuid="35ecb629-90f6-4af1-b1fa-042bfb0cba8d">
Apr 13 19:33:22 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 19:33:22 user nova-compute[71692]:         </nova:port>
Apr 13 19:33:22 user nova-compute[71692]:       </nova:ports>
Apr 13 19:33:22 user nova-compute[71692]:     </nova:instance>
Apr 13 19:33:22 user nova-compute[71692]:   </metadata>
Apr 13 19:33:22 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:33:22 user nova-compute[71692]:     <system>
Apr 13 19:33:22 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:33:22 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:33:22 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:33:22 user nova-compute[71692]:       <entry name="serial">f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c</entry>
Apr 13 19:33:22 user nova-compute[71692]:       <entry name="uuid">f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c</entry>
Apr 13 19:33:22 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:33:22 user nova-compute[71692]:     </system>
Apr 13 19:33:22 user nova-compute[71692]:   </sysinfo>
Apr 13 19:33:22 user nova-compute[71692]:   <os>
Apr 13 19:33:22 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:33:22 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:33:22 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:33:22 user nova-compute[71692]:   </os>
Apr 13 19:33:22 user nova-compute[71692]:   <features>
Apr 13 19:33:22 user nova-compute[71692]:     <acpi/>
Apr 13 19:33:22 user nova-compute[71692]:     <apic/>
Apr 13 19:33:22 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:33:22 user nova-compute[71692]:   </features>
Apr 13 19:33:22 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:33:22 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:33:22 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:33:22 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:33:22 user nova-compute[71692]:   </clock>
Apr 13 19:33:22 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:33:22 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:33:22 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:33:22 user nova-compute[71692]:   </cpu>
Apr 13 19:33:22 user nova-compute[71692]:   <devices>
Apr 13 19:33:22 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:33:22 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:33:22 user nova-compute[71692]:       <source dev="/dev/sdd"/>
Apr 13 19:33:22 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:33:22 user nova-compute[71692]:       <serial>859d56a6-4c86-402c-9b6c-564c027c53d5</serial>
Apr 13 19:33:22 user nova-compute[71692]:     </disk>
Apr 13 19:33:22 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:33:22 user nova-compute[71692]:       <mac address="fa:16:3e:99:96:34"/>
Apr 13 19:33:22 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:33:22 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:33:22 user nova-compute[71692]:       <target dev="tap35ecb629-90"/>
Apr 13 19:33:22 user nova-compute[71692]:     </interface>
Apr 13 19:33:22 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:33:22 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c/console.log" append="off"/>
Apr 13 19:33:22 user nova-compute[71692]:     </serial>
Apr 13 19:33:22 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:33:22 user nova-compute[71692]:     <video>
Apr 13 19:33:22 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:33:22 user nova-compute[71692]:     </video>
Apr 13 19:33:22 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:33:22 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:33:22 user nova-compute[71692]:     </rng>
Apr 13 19:33:22 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:33:22 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:33:22 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:33:22 user nova-compute[71692]:     </memballoon>
Apr 13 19:33:22 user nova-compute[71692]:   </devices>
Apr 13 19:33:22 user nova-compute[71692]: </domain>
Apr 13 19:33:22 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1195708667',display_name='tempest-TestVolumeBootPattern-server-1195708667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1195708667',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj7TcL9FU0ycuamYqYTfleaq2m4r0SEirSHRlkPBcG/eCMlwnGnrLneKNOsIY4WhqDyz6ZvULFdimsQ4U+9lxxBdfuyuTJJKa1K6nRrg6kFRx2pkuS1DtxEUpZtRdywRA==',key_name='tempest-TestVolumeBootPattern-1410205426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-bgkdcv4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:33:15Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "address": "fa:16:3e:99:96:34", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ecb629-90", "ovs_interfaceid": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "address": "fa:16:3e:99:96:34", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ecb629-90", "ovs_interfaceid": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:96:34,bridge_name='br-int',has_traffic_filtering=True,id=35ecb629-90f6-4af1-b1fa-042bfb0cba8d,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ecb629-90') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG os_vif [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:96:34,bridge_name='br-int',has_traffic_filtering=True,id=35ecb629-90f6-4af1-b1fa-042bfb0cba8d,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ecb629-90') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35ecb629-90, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35ecb629-90, col_values=(('external_ids', {'iface-id': '35ecb629-90f6-4af1-b1fa-042bfb0cba8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:96:34', 'vm-uuid': 'f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:22 user nova-compute[71692]: INFO os_vif [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:96:34,bridge_name='br-int',has_traffic_filtering=True,id=35ecb629-90f6-4af1-b1fa-042bfb0cba8d,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ecb629-90')
Apr 13 19:33:22 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] No VIF found with MAC fa:16:3e:99:96:34, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-669ba22b-1412-4976-96ca-a41fbf36b4ab req-e8744157-8300-4c4a-8da4-240e66739324 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-669ba22b-1412-4976-96ca-a41fbf36b4ab req-e8744157-8300-4c4a-8da4-240e66739324 service nova] Acquiring lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-669ba22b-1412-4976-96ca-a41fbf36b4ab req-e8744157-8300-4c4a-8da4-240e66739324 service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-669ba22b-1412-4976-96ca-a41fbf36b4ab req-e8744157-8300-4c4a-8da4-240e66739324 service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:33:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-669ba22b-1412-4976-96ca-a41fbf36b4ab req-e8744157-8300-4c4a-8da4-240e66739324 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] No waiting events found dispatching network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:33:22 user nova-compute[71692]: WARNING nova.compute.manager [req-669ba22b-1412-4976-96ca-a41fbf36b4ab req-e8744157-8300-4c4a-8da4-240e66739324 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received unexpected event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e for instance with vm_state building and task_state spawning.
Apr 13 19:33:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] Acquiring lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] No waiting events found dispatching network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:33:24 user nova-compute[71692]: WARNING nova.compute.manager [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received unexpected event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e for instance with vm_state building and task_state spawning.
Apr 13 19:33:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Received event network-vif-plugged-35ecb629-90f6-4af1-b1fa-042bfb0cba8d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] Acquiring lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] Lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] Lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] No waiting events found dispatching network-vif-plugged-35ecb629-90f6-4af1-b1fa-042bfb0cba8d {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:33:24 user nova-compute[71692]: WARNING nova.compute.manager [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Received unexpected event network-vif-plugged-35ecb629-90f6-4af1-b1fa-042bfb0cba8d for instance with vm_state building and task_state spawning.
Apr 13 19:33:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Received event network-vif-plugged-35ecb629-90f6-4af1-b1fa-042bfb0cba8d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] Acquiring lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] Lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] Lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:33:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] No waiting events found dispatching network-vif-plugged-35ecb629-90f6-4af1-b1fa-042bfb0cba8d {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:33:24 user nova-compute[71692]: WARNING nova.compute.manager [req-23e6feaf-990c-411f-a39e-9c490edf6025 req-ec088eaa-0d3a-4391-aec5-13aa85f8110f service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Received unexpected event network-vif-plugged-35ecb629-90f6-4af1-b1fa-042bfb0cba8d for instance with vm_state building and task_state spawning.
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414405.1073234, f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:33:25 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] VM Resumed (Lifecycle Event)
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:33:25 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Instance spawned successfully.
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:33:25 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414405.1097994, f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:33:25 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] VM Started (Lifecycle Event)
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:33:25 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:33:25 user nova-compute[71692]: INFO nova.compute.manager [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Took 5.90 seconds to spawn the instance on the hypervisor.
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:33:25 user nova-compute[71692]: INFO nova.compute.manager [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Took 16.68 seconds to build instance.
Apr 13 19:33:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-24fa9921-9553-4ef9-9ebd-2deedfefc4cc tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.769s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414405.6261625, f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:33:25 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] VM Resumed (Lifecycle Event)
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:33:25 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Instance spawned successfully.
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:33:25 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414405.629093, f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:33:25 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] VM Started (Lifecycle Event)
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:33:25 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:33:25 user nova-compute[71692]: INFO nova.compute.manager [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Took 6.46 seconds to spawn the instance on the hypervisor.
Apr 13 19:33:25 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:33:25 user nova-compute[71692]: INFO nova.compute.manager [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Took 11.87 seconds to build instance.
Apr 13 19:33:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0cc5e84f-08a5-48aa-af14-b204be5e512d tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.957s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:33:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:33:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:33:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:33:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:33:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:33:57 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:33:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:00 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:34:01 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:34:01 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:34:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:34:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:34:01 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:34:01 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Updating instance_info_cache with network_info: [{"id": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "address": "fa:16:3e:c5:4f:ac", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ac5520-b0", "ovs_interfaceid": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:34:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:34:01 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:34:01 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:34:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:03 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:34:04 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:34:04 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:34:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:34:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:34:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:34:04 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:34:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:04 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:34:05 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:34:05 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:34:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8343MB free_disk=25.831829071044922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 86893da2-3681-4a37-a6fc-1f56a2682070 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:34:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:34:06 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:34:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:34:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:34:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid 991871a0-3a4e-4014-b07f-3e8c49eeda5a {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid 86893da2-3681-4a37-a6fc-1f56a2682070 {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "86893da2-3681-4a37-a6fc-1f56a2682070" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "86893da2-3681-4a37-a6fc-1f56a2682070" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "86893da2-3681-4a37-a6fc-1f56a2682070" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:34:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:34:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:34:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:34:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:34:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:34:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "86893da2-3681-4a37-a6fc-1f56a2682070" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "86893da2-3681-4a37-a6fc-1f56a2682070" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG nova.objects.instance [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'flavor' on Instance uuid 86893da2-3681-4a37-a6fc-1f56a2682070 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "86893da2-3681-4a37-a6fc-1f56a2682070" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "86893da2-3681-4a37-a6fc-1f56a2682070" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "86893da2-3681-4a37-a6fc-1f56a2682070" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:34:30 user nova-compute[71692]: INFO nova.compute.manager [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Attaching volume c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d to /dev/vdb
Apr 13 19:34:30 user nova-compute[71692]: DEBUG os_brick.utils [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3642968c-1ef0-4887-a9f9-9dd4cec8f427]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[135b76fa-6cae-4c13-ac57-e704af68b4c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f50fa2-f3ca-47f1-9f6a-b253111b7106]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[30432fb2-269e-415b-8069-f70c23ebea0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:34:30 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:34:30 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2df48c4-890d-4034-88fb-d25f478106b8]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG os_brick.utils [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:34:30 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Updating existing volume attachment record: e89f71db-7892-4562-88cb-5357bd41064b {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:34:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:34:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LzcwYReQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:34:35 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:34:35 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:34:35 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[74928338-87fd-46e6-a829-036cdb700804]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:34:35 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa4c92d-9eb9-4bc4-bc7e-fe28d6e9823d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d] added
Apr 13 19:34:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e289086d-35cc-4ed3-ba7f-c8ad833be4e3]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b9424b-4fed-469b-b16f-d9ac5b48fc22]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LzcwYReQ {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LzcwYReQ" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b847d7dd-6ae1-434b-8b89-3da9c0f0ab51]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LzcwYReQ'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1657f560-5a3e-4237-9bef-f5a6b5ba745f]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a21d427-0cb3-4f6b-b0ba-084455017ee0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:34:35 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:34:35 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:34:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:34:35 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:34:35 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:34:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1a7aef-2b59-48fc-9389-a636e2778dfa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d, portal: 172.16.0.220,3260]
Apr 13 19:34:35 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d, portal: 172.16.0.220,3260] successful.
Apr 13 19:34:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[94350e48-446a-4275-a79c-b682c06e63d4]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd7a1bd-ccfb-47c8-b393-02b6fd438af7]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:34:35 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:34:35 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:34:35 user nova-compute[71692]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d (non-flash)
Apr 13 19:34:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:34:35 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:34:35 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:34:35 user nova-compute[71692]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d (non-flash)
Apr 13 19:34:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fc4fee-fb20-42c2-a62c-7dbc94b01cfa]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:34:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LzcwYReQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:34:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:34:36 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26536316362323730', 'path': '/dev/sde'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:34:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536316362323730', 'path': '/dev/sde'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:34:36 user nova-compute[71692]: DEBUG nova.objects.instance [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'flavor' on Instance uuid 86893da2-3681-4a37-a6fc-1f56a2682070 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:34:36 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 19:34:36 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:34:36 user nova-compute[71692]:   <source dev="/dev/sde"/>
Apr 13 19:34:36 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:34:36 user nova-compute[71692]:   <serial>c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d</serial>
Apr 13 19:34:36 user nova-compute[71692]: </disk>
Apr 13 19:34:36 user nova-compute[71692]:  {{(pid=71692) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 19:34:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:34:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:34:37 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] No VIF found with MAC fa:16:3e:27:ff:c3, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:34:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:37 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d3bfc12c-1670-4249-8626-aa767397050e tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "86893da2-3681-4a37-a6fc-1f56a2682070" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.636s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:34:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-b45d245e-5421-4639-b1b1-4b21c149263c req-e095eaaa-092e-40d1-b68c-c64ea1b17255 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received event network-changed-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:34:40 user nova-compute[71692]: DEBUG nova.compute.manager [req-b45d245e-5421-4639-b1b1-4b21c149263c req-e095eaaa-092e-40d1-b68c-c64ea1b17255 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Refreshing instance network info cache due to event network-changed-c940609d-fa89-4382-ad90-bba2f3f551f3. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:34:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b45d245e-5421-4639-b1b1-4b21c149263c req-e095eaaa-092e-40d1-b68c-c64ea1b17255 service nova] Acquiring lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:34:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b45d245e-5421-4639-b1b1-4b21c149263c req-e095eaaa-092e-40d1-b68c-c64ea1b17255 service nova] Acquired lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:34:40 user nova-compute[71692]: DEBUG nova.network.neutron [req-b45d245e-5421-4639-b1b1-4b21c149263c req-e095eaaa-092e-40d1-b68c-c64ea1b17255 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Refreshing network info cache for port c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:34:40 user nova-compute[71692]: DEBUG nova.network.neutron [req-b45d245e-5421-4639-b1b1-4b21c149263c req-e095eaaa-092e-40d1-b68c-c64ea1b17255 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Updated VIF entry in instance network info cache for port c940609d-fa89-4382-ad90-bba2f3f551f3. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:34:40 user nova-compute[71692]: DEBUG nova.network.neutron [req-b45d245e-5421-4639-b1b1-4b21c149263c req-e095eaaa-092e-40d1-b68c-c64ea1b17255 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Updating instance_info_cache with network_info: [{"id": "c940609d-fa89-4382-ad90-bba2f3f551f3", "address": "fa:16:3e:27:ff:c3", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940609d-fa", "ovs_interfaceid": "c940609d-fa89-4382-ad90-bba2f3f551f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:34:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-b45d245e-5421-4639-b1b1-4b21c149263c req-e095eaaa-092e-40d1-b68c-c64ea1b17255 service nova] Releasing lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:34:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-d8b36ec9-ea22-40b3-9ef8-e9f09b9cf169 req-8069a868-b65b-4948-af7c-174a34442935 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received event network-changed-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:34:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-d8b36ec9-ea22-40b3-9ef8-e9f09b9cf169 req-8069a868-b65b-4948-af7c-174a34442935 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Refreshing instance network info cache due to event network-changed-c940609d-fa89-4382-ad90-bba2f3f551f3. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:34:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d8b36ec9-ea22-40b3-9ef8-e9f09b9cf169 req-8069a868-b65b-4948-af7c-174a34442935 service nova] Acquiring lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:34:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d8b36ec9-ea22-40b3-9ef8-e9f09b9cf169 req-8069a868-b65b-4948-af7c-174a34442935 service nova] Acquired lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:34:42 user nova-compute[71692]: DEBUG nova.network.neutron [req-d8b36ec9-ea22-40b3-9ef8-e9f09b9cf169 req-8069a868-b65b-4948-af7c-174a34442935 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Refreshing network info cache for port c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:34:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "86893da2-3681-4a37-a6fc-1f56a2682070" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:34:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "86893da2-3681-4a37-a6fc-1f56a2682070" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:34:42 user nova-compute[71692]: INFO nova.compute.manager [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Rebooting instance
Apr 13 19:34:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:34:42 user nova-compute[71692]: DEBUG nova.network.neutron [req-d8b36ec9-ea22-40b3-9ef8-e9f09b9cf169 req-8069a868-b65b-4948-af7c-174a34442935 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Updated VIF entry in instance network info cache for port c940609d-fa89-4382-ad90-bba2f3f551f3. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:34:42 user nova-compute[71692]: DEBUG nova.network.neutron [req-d8b36ec9-ea22-40b3-9ef8-e9f09b9cf169 req-8069a868-b65b-4948-af7c-174a34442935 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Updating instance_info_cache with network_info: [{"id": "c940609d-fa89-4382-ad90-bba2f3f551f3", "address": "fa:16:3e:27:ff:c3", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940609d-fa", "ovs_interfaceid": "c940609d-fa89-4382-ad90-bba2f3f551f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:34:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d8b36ec9-ea22-40b3-9ef8-e9f09b9cf169 req-8069a868-b65b-4948-af7c-174a34442935 service nova] Releasing lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:34:42 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquired lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:34:42 user nova-compute[71692]: DEBUG nova.network.neutron [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:34:43 user nova-compute[71692]: DEBUG nova.network.neutron [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Updating instance_info_cache with network_info: [{"id": "c940609d-fa89-4382-ad90-bba2f3f551f3", "address": "fa:16:3e:27:ff:c3", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940609d-fa", "ovs_interfaceid": "c940609d-fa89-4382-ad90-bba2f3f551f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:34:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Releasing lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:34:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:34:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:45 user nova-compute[71692]: DEBUG nova.compute.manager [req-7d3d65ad-9e5f-410d-96d2-ce27873805f5 req-c13742b9-3edb-43f3-8c3f-1fd1be7c0c70 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received event network-vif-unplugged-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:34:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7d3d65ad-9e5f-410d-96d2-ce27873805f5 req-c13742b9-3edb-43f3-8c3f-1fd1be7c0c70 service nova] Acquiring lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:34:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7d3d65ad-9e5f-410d-96d2-ce27873805f5 req-c13742b9-3edb-43f3-8c3f-1fd1be7c0c70 service nova] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:34:45 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7d3d65ad-9e5f-410d-96d2-ce27873805f5 req-c13742b9-3edb-43f3-8c3f-1fd1be7c0c70 service nova] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:34:45 user nova-compute[71692]: DEBUG nova.compute.manager [req-7d3d65ad-9e5f-410d-96d2-ce27873805f5 req-c13742b9-3edb-43f3-8c3f-1fd1be7c0c70 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] No waiting events found dispatching network-vif-unplugged-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:34:45 user nova-compute[71692]: WARNING nova.compute.manager [req-7d3d65ad-9e5f-410d-96d2-ce27873805f5 req-c13742b9-3edb-43f3-8c3f-1fd1be7c0c70 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received unexpected event network-vif-unplugged-c940609d-fa89-4382-ad90-bba2f3f551f3 for instance with vm_state active and task_state reboot_started.
Apr 13 19:34:46 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Instance shutdown successfully.
Apr 13 19:34:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-aebfa13f-665f-4a99-b336-4d336da109cf req-5f4bdd26-72dc-4a5d-9459-89d47d9ba04b service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received event network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:34:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-aebfa13f-665f-4a99-b336-4d336da109cf req-5f4bdd26-72dc-4a5d-9459-89d47d9ba04b service nova] Acquiring lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:34:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-aebfa13f-665f-4a99-b336-4d336da109cf req-5f4bdd26-72dc-4a5d-9459-89d47d9ba04b service nova] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:34:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-aebfa13f-665f-4a99-b336-4d336da109cf req-5f4bdd26-72dc-4a5d-9459-89d47d9ba04b service nova] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:34:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-aebfa13f-665f-4a99-b336-4d336da109cf req-5f4bdd26-72dc-4a5d-9459-89d47d9ba04b service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] No waiting events found dispatching network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:34:47 user nova-compute[71692]: WARNING nova.compute.manager [req-aebfa13f-665f-4a99-b336-4d336da109cf req-5f4bdd26-72dc-4a5d-9459-89d47d9ba04b service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received unexpected event network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 for instance with vm_state active and task_state reboot_started.
Apr 13 19:34:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:49 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Removed pending event for 86893da2-3681-4a37-a6fc-1f56a2682070 due to event {{(pid=71692) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 19:34:49 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414489.9393063, 86893da2-3681-4a37-a6fc-1f56a2682070 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:34:49 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] VM Resumed (Lifecycle Event)
Apr 13 19:34:49 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Instance running successfully.
Apr 13 19:34:49 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Instance soft rebooted successfully.
Apr 13 19:34:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:34:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:34:49 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:34:49 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 13 19:34:49 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414489.941346, 86893da2-3681-4a37-a6fc-1f56a2682070 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:34:49 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] VM Started (Lifecycle Event)
Apr 13 19:34:49 user nova-compute[71692]: DEBUG nova.compute.manager [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received event network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:34:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] Acquiring lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:34:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:34:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:34:49 user nova-compute[71692]: DEBUG nova.compute.manager [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] No waiting events found dispatching network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:34:49 user nova-compute[71692]: WARNING nova.compute.manager [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received unexpected event network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 for instance with vm_state active and task_state reboot_started.
Apr 13 19:34:49 user nova-compute[71692]: DEBUG nova.compute.manager [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received event network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:34:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] Acquiring lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:34:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:34:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:34:50 user nova-compute[71692]: DEBUG nova.compute.manager [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] No waiting events found dispatching network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:34:50 user nova-compute[71692]: WARNING nova.compute.manager [req-49b66280-962a-4bd5-b5cc-a753e17405fc req-c7c9ccb1-3f5b-4ea6-bb0e-46d8e9fb2a4f service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received unexpected event network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 for instance with vm_state active and task_state reboot_started.
Apr 13 19:34:50 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:34:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-59d073f4-34e9-4b8b-8b66-e81abd4bafed tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "86893da2-3681-4a37-a6fc-1f56a2682070" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.295s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:34:50 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:34:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:34:59 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:34:59 user nova-compute[71692]: INFO nova.compute.manager [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Rescuing
Apr 13 19:34:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "refresh_cache-f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:34:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquired lock "refresh_cache-f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:34:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:34:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Updating instance_info_cache with network_info: [{"id": "7d634c23-9eff-4a07-8036-b5ddc748828e", "address": "fa:16:3e:99:28:62", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d634c23-9e", "ovs_interfaceid": "7d634c23-9eff-4a07-8036-b5ddc748828e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:34:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Releasing lock "refresh_cache-f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:34:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:00 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:35:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-90d4f9aa-9610-4473-896e-3710105589f0 req-90b3eda5-6190-44d5-b3d9-8348b6de6e55 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received event network-vif-unplugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:35:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-90d4f9aa-9610-4473-896e-3710105589f0 req-90b3eda5-6190-44d5-b3d9-8348b6de6e55 service nova] Acquiring lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:35:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-90d4f9aa-9610-4473-896e-3710105589f0 req-90b3eda5-6190-44d5-b3d9-8348b6de6e55 service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:35:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-90d4f9aa-9610-4473-896e-3710105589f0 req-90b3eda5-6190-44d5-b3d9-8348b6de6e55 service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:35:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-90d4f9aa-9610-4473-896e-3710105589f0 req-90b3eda5-6190-44d5-b3d9-8348b6de6e55 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] No waiting events found dispatching network-vif-unplugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:35:00 user nova-compute[71692]: WARNING nova.compute.manager [req-90d4f9aa-9610-4473-896e-3710105589f0 req-90b3eda5-6190-44d5-b3d9-8348b6de6e55 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received unexpected event network-vif-unplugged-7d634c23-9eff-4a07-8036-b5ddc748828e for instance with vm_state active and task_state rescuing.
Apr 13 19:35:00 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Instance destroyed successfully.
Apr 13 19:35:00 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Attempting a stable device rescue
Apr 13 19:35:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71692) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 19:35:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Instance directory exists: not creating {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 19:35:00 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Creating image(s)
Apr 13 19:35:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:35:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "/opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:35:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "/opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:35:00 user nova-compute[71692]: DEBUG nova.objects.instance [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'trusted_certs' on Instance uuid f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:35:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "ee15ca704e22aa187e466087287d5e0e8aed654d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:35:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "ee15ca704e22aa187e466087287d5e0e8aed654d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:35:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee15ca704e22aa187e466087287d5e0e8aed654d.part --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee15ca704e22aa187e466087287d5e0e8aed654d.part --force-share --output=json" returned: 0 in 0.149s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:01 user nova-compute[71692]: DEBUG nova.virt.images [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] 067fd318-fa29-4977-bde7-099e19c05db4 was qcow2, converting to raw {{(pid=71692) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 19:35:01 user nova-compute[71692]: DEBUG nova.privsep.utils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71692) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 19:35:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee15ca704e22aa187e466087287d5e0e8aed654d.part /opt/stack/data/nova/instances/_base/ee15ca704e22aa187e466087287d5e0e8aed654d.converted {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee15ca704e22aa187e466087287d5e0e8aed654d.part /opt/stack/data/nova/instances/_base/ee15ca704e22aa187e466087287d5e0e8aed654d.converted" returned: 0 in 0.393s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee15ca704e22aa187e466087287d5e0e8aed654d.converted --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee15ca704e22aa187e466087287d5e0e8aed654d.converted --force-share --output=json" returned: 0 in 0.151s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "ee15ca704e22aa187e466087287d5e0e8aed654d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.553s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "ee15ca704e22aa187e466087287d5e0e8aed654d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "ee15ca704e22aa187e466087287d5e0e8aed654d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee15ca704e22aa187e466087287d5e0e8aed654d --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee15ca704e22aa187e466087287d5e0e8aed654d --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee15ca704e22aa187e466087287d5e0e8aed654d,backing_fmt=raw /opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/disk.rescue {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee15ca704e22aa187e466087287d5e0e8aed654d,backing_fmt=raw /opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/disk.rescue" returned: 0 in 0.053s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "ee15ca704e22aa187e466087287d5e0e8aed654d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.objects.instance [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'migration_context' on Instance uuid f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Start _get_guest_xml network_info=[{"id": "7d634c23-9eff-4a07-8036-b5ddc748828e", "address": "fa:16:3e:99:28:62", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "vif_mac": "fa:16:3e:99:28:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d634c23-9e", "ovs_interfaceid": "7d634c23-9eff-4a07-8036-b5ddc748828e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '067fd318-fa29-4977-bde7-099e19c05db4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'e8796bab-4e5f-4657-80cb-f821812f0ba4', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgbNGHKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76', 'attached_at': '', 'detached_at': '', 'volume_id': '06e23084-c70b-425b-bd8a-e524d1f48258', 'serial': '06e23084-c70b-425b-bd8a-e524d1f48258'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.objects.instance [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'resources' on Instance uuid f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.objects.instance [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'numa_topology' on Instance uuid f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:35:02 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:35:02 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.objects.instance [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'vcpu_model' on Instance uuid f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.compute.manager [req-a8a27766-a6b6-4890-8994-e6dc986beaa8 req-d77c6873-1f41-403a-b773-e12fee8fbbdb service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a8a27766-a6b6-4890-8994-e6dc986beaa8 req-d77c6873-1f41-403a-b773-e12fee8fbbdb service nova] Acquiring lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a8a27766-a6b6-4890-8994-e6dc986beaa8 req-d77c6873-1f41-403a-b773-e12fee8fbbdb service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-a8a27766-a6b6-4890-8994-e6dc986beaa8 req-d77c6873-1f41-403a-b773-e12fee8fbbdb service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.compute.manager [req-a8a27766-a6b6-4890-8994-e6dc986beaa8 req-d77c6873-1f41-403a-b773-e12fee8fbbdb service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] No waiting events found dispatching network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:35:02 user nova-compute[71692]: WARNING nova.compute.manager [req-a8a27766-a6b6-4890-8994-e6dc986beaa8 req-d77c6873-1f41-403a-b773-e12fee8fbbdb service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received unexpected event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e for instance with vm_state active and task_state rescuing.
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgbNGHKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:35:02 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:35:02 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:35:02 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e2f474-64d7-4529-bd0e-4ccaeaa84c7d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pgbNGHKr\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 19:35:02 user nova-compute[71692]: node.name = iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258
Apr 13 19:35:02 user nova-compute[71692]: node.tpgt = -1
Apr 13 19:35:02 user nova-compute[71692]: node.startup = automatic
Apr 13 19:35:02 user nova-compute[71692]: node.leading_login = No
Apr 13 19:35:02 user nova-compute[71692]: iface.iscsi_ifacename = default
Apr 13 19:35:02 user nova-compute[71692]: iface.net_ifacename = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.ipaddress = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.prefix_len = 0
Apr 13 19:35:02 user nova-compute[71692]: iface.hwaddress = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.transport_name = tcp
Apr 13 19:35:02 user nova-compute[71692]: iface.initiatorname = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.state = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.vlan_id = 0
Apr 13 19:35:02 user nova-compute[71692]: iface.vlan_priority = 0
Apr 13 19:35:02 user nova-compute[71692]: iface.vlan_state = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.iface_num = 0
Apr 13 19:35:02 user nova-compute[71692]: iface.mtu = 0
Apr 13 19:35:02 user nova-compute[71692]: iface.port = 0
Apr 13 19:35:02 user nova-compute[71692]: iface.bootproto = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.subnet_mask = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.gateway = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.dhcp_alt_client_id = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.dhcp_dns = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.dhcp_learn_iqn = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.dhcp_vendor_id_state = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.dhcp_vendor_id = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.dhcp_slp_da = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.fragmentation = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.gratuitous_arp = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.incoming_forwarding = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.tos_state = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.tos = 0
Apr 13 19:35:02 user nova-compute[71692]: iface.ttl = 0
Apr 13 19:35:02 user nova-compute[71692]: iface.delayed_ack = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.tcp_nagle = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.tcp_wsf_state = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.tcp_wsf = 0
Apr 13 19:35:02 user nova-compute[71692]: iface.tcp_timer_scale = 0
Apr 13 19:35:02 user nova-compute[71692]: iface.tcp_timestamp = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.redirect = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.def_task_mgmt_timeout = 0
Apr 13 19:35:02 user nova-compute[71692]: iface.header_digest = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.data_digest = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.immediate_data = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.initial_r2t = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.data_seq_inorder = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.data_pdu_inorder = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.erl = 0
Apr 13 19:35:02 user nova-compute[71692]: iface.max_receive_data_len = 0
Apr 13 19:35:02 user nova-compute[71692]: iface.first_burst_len = 0
Apr 13 19:35:02 user nova-compute[71692]: iface.max_outstanding_r2t = 0
Apr 13 19:35:02 user nova-compute[71692]: iface.max_burst_len = 0
Apr 13 19:35:02 user nova-compute[71692]: iface.chap_auth = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.bidi_chap = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.strict_login_compliance = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.discovery_auth = <empty>
Apr 13 19:35:02 user nova-compute[71692]: iface.discovery_logout = <empty>
Apr 13 19:35:02 user nova-compute[71692]: node.discovery_address = <empty>
Apr 13 19:35:02 user nova-compute[71692]: node.discovery_port = 0
Apr 13 19:35:02 user nova-compute[71692]: node.discovery_type = static
Apr 13 19:35:02 user nova-compute[71692]: node.session.initial_cmdsn = 0
Apr 13 19:35:02 user nova-compute[71692]: node.session.initial_login_retry_max = 8
Apr 13 19:35:02 user nova-compute[71692]: node.session.xmit_thread_priority = -20
Apr 13 19:35:02 user nova-compute[71692]: node.session.cmds_max = 128
Apr 13 19:35:02 user nova-compute[71692]: node.session.queue_depth = 32
Apr 13 19:35:02 user nova-compute[71692]: node.session.nr_sessions = 1
Apr 13 19:35:02 user nova-compute[71692]: node.session.auth.authmethod = CHAP
Apr 13 19:35:02 user nova-compute[71692]: node.session.auth.username = pgbNGHKr
Apr 13 19:35:02 user nova-compute[71692]: node.session.auth.password = ***
Apr 13 19:35:02 user nova-compute[71692]: node.session.auth.username_in = <empty>
Apr 13 19:35:02 user nova-compute[71692]: node.session.auth.password_in = <empty>
Apr 13 19:35:02 user nova-compute[71692]: node.session.auth.chap_algs = MD5
Apr 13 19:35:02 user nova-compute[71692]: node.session.timeo.replacement_timeout = 120
Apr 13 19:35:02 user nova-compute[71692]: node.session.err_timeo.abort_timeout = 15
Apr 13 19:35:02 user nova-compute[71692]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 19:35:02 user nova-compute[71692]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 19:35:02 user nova-compute[71692]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 19:35:02 user nova-compute[71692]: node.session.iscsi.FastAbort = Yes
Apr 13 19:35:02 user nova-compute[71692]: node.session.iscsi.InitialR2T = No
Apr 13 19:35:02 user nova-compute[71692]: node.session.iscsi.ImmediateData = Yes
Apr 13 19:35:02 user nova-compute[71692]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 19:35:02 user nova-compute[71692]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 19:35:02 user nova-compute[71692]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 19:35:02 user nova-compute[71692]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 19:35:02 user nova-compute[71692]: node.session.iscsi.MaxConnections = 1
Apr 13 19:35:02 user nova-compute[71692]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 19:35:02 user nova-compute[71692]: node.session.iscsi.ERL = 0
Apr 13 19:35:02 user nova-compute[71692]: node.session.scan = manual
Apr 13 19:35:02 user nova-compute[71692]: node.session.reopen_max = 0
Apr 13 19:35:02 user nova-compute[71692]: node.conn[0].address = 172.16.0.220
Apr 13 19:35:02 user nova-compute[71692]: node.conn[0].port = 3260
Apr 13 19:35:02 user nova-compute[71692]: node.conn[0].startup = manual
Apr 13 19:35:02 user nova-compute[71692]: node.conn[0].tcp.window_size = 524288
Apr 13 19:35:02 user nova-compute[71692]: node.conn[0].tcp.type_of_service = 0
Apr 13 19:35:02 user nova-compute[71692]: node.conn[0].timeo.logout_timeout = 15
Apr 13 19:35:02 user nova-compute[71692]: node.conn[0].timeo.login_timeout = 15
Apr 13 19:35:02 user nova-compute[71692]: node.conn[0].timeo.auth_timeout = 45
Apr 13 19:35:02 user nova-compute[71692]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 19:35:02 user nova-compute[71692]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 19:35:02 user nova-compute[71692]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 19:35:02 user nova-compute[71692]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 19:35:02 user nova-compute[71692]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 19:35:02 user nova-compute[71692]: node.conn[0].iscsi.DataDigest = None
Apr 13 19:35:02 user nova-compute[71692]: node.conn[0].iscsi.IFMarker = No
Apr 13 19:35:02 user nova-compute[71692]: node.conn[0].iscsi.OFMarker = No
Apr 13 19:35:02 user nova-compute[71692]: # END RECORD
Apr 13 19:35:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff6d400-bf46-4429-94cb-bdbfa7e08cbf]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5005252-bd5f-4da2-914d-1eb07c540b26]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgbNGHKr {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgbNGHKr" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[59085848-a019-4ce3-bd9c-b61164dfb3e9]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pgbNGHKr'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd79ad32-2271-4c97-ada1-983f2c001ec1]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[75542795-71cc-4615-ae5e-1858880ad3c3]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:35:02 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:35:02 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:35:02 user nova-compute[71692]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d (non-flash)
Apr 13 19:35:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:35:02 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:35:02 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:35:02 user nova-compute[71692]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d (non-flash)
Apr 13 19:35:02 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] HCTL ('34', '0', '0', 0) found on session 51 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca43446-739a-468d-bcf6-c455b8431584]: (4, ('0 0 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Searching for a device in session 51 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgbNGHKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.174s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] <== connect_volume: return (175ms) {'type': 'block', 'scsi_wwn': '23030656664653764', 'path': '/dev/sdc'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030656664653764', 'path': '/dev/sdc'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-613518771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-613518771',id=44,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:33:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c00a7fcd6d3040e8b2db0448eeda93ad',ramdisk_id='',reservation_id='r-acdbcv8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:33:25Z,user_data=None,user_id='dd604fa4d17b42b1abea8c2f2405b58d',uuid=f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d634c23-9eff-4a07-8036-b5ddc748828e", "address": "fa:16:3e:99:28:62", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "vif_mac": "fa:16:3e:99:28:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d634c23-9e", "ovs_interfaceid": "7d634c23-9eff-4a07-8036-b5ddc748828e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converting VIF {"id": "7d634c23-9eff-4a07-8036-b5ddc748828e", "address": "fa:16:3e:99:28:62", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "vif_mac": "fa:16:3e:99:28:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d634c23-9e", "ovs_interfaceid": "7d634c23-9eff-4a07-8036-b5ddc748828e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:28:62,bridge_name='br-int',has_traffic_filtering=True,id=7d634c23-9eff-4a07-8036-b5ddc748828e,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d634c23-9e') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.objects.instance [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'pci_devices' on Instance uuid f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:35:02 user nova-compute[71692]:   <uuid>f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76</uuid>
Apr 13 19:35:02 user nova-compute[71692]:   <name>instance-0000002c</name>
Apr 13 19:35:02 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:35:02 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:35:02 user nova-compute[71692]:   <metadata>
Apr 13 19:35:02 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:35:02 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:35:02 user nova-compute[71692]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-613518771</nova:name>
Apr 13 19:35:02 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:35:02</nova:creationTime>
Apr 13 19:35:02 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:35:02 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:35:02 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:35:02 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:35:02 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:35:02 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:35:02 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:35:02 user nova-compute[71692]:       <nova:owner>
Apr 13 19:35:02 user nova-compute[71692]:         <nova:user uuid="dd604fa4d17b42b1abea8c2f2405b58d">tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member</nova:user>
Apr 13 19:35:02 user nova-compute[71692]:         <nova:project uuid="c00a7fcd6d3040e8b2db0448eeda93ad">tempest-ServerBootFromVolumeStableRescueTest-1051313256</nova:project>
Apr 13 19:35:02 user nova-compute[71692]:       </nova:owner>
Apr 13 19:35:02 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:35:02 user nova-compute[71692]:       <nova:ports>
Apr 13 19:35:02 user nova-compute[71692]:         <nova:port uuid="7d634c23-9eff-4a07-8036-b5ddc748828e">
Apr 13 19:35:02 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 19:35:02 user nova-compute[71692]:         </nova:port>
Apr 13 19:35:02 user nova-compute[71692]:       </nova:ports>
Apr 13 19:35:02 user nova-compute[71692]:     </nova:instance>
Apr 13 19:35:02 user nova-compute[71692]:   </metadata>
Apr 13 19:35:02 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:35:02 user nova-compute[71692]:     <system>
Apr 13 19:35:02 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:35:02 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:35:02 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:35:02 user nova-compute[71692]:       <entry name="serial">f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76</entry>
Apr 13 19:35:02 user nova-compute[71692]:       <entry name="uuid">f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76</entry>
Apr 13 19:35:02 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:35:02 user nova-compute[71692]:     </system>
Apr 13 19:35:02 user nova-compute[71692]:   </sysinfo>
Apr 13 19:35:02 user nova-compute[71692]:   <os>
Apr 13 19:35:02 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:35:02 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:35:02 user nova-compute[71692]:   </os>
Apr 13 19:35:02 user nova-compute[71692]:   <features>
Apr 13 19:35:02 user nova-compute[71692]:     <acpi/>
Apr 13 19:35:02 user nova-compute[71692]:     <apic/>
Apr 13 19:35:02 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:35:02 user nova-compute[71692]:   </features>
Apr 13 19:35:02 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:35:02 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:35:02 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:35:02 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:35:02 user nova-compute[71692]:   </clock>
Apr 13 19:35:02 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:35:02 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:35:02 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:35:02 user nova-compute[71692]:   </cpu>
Apr 13 19:35:02 user nova-compute[71692]:   <devices>
Apr 13 19:35:02 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:35:02 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:35:02 user nova-compute[71692]:       <source dev="/dev/sdc"/>
Apr 13 19:35:02 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:35:02 user nova-compute[71692]:       <serial>06e23084-c70b-425b-bd8a-e524d1f48258</serial>
Apr 13 19:35:02 user nova-compute[71692]:     </disk>
Apr 13 19:35:02 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:35:02 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:35:02 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/disk.rescue"/>
Apr 13 19:35:02 user nova-compute[71692]:       <target dev="vdb" bus="virtio"/>
Apr 13 19:35:02 user nova-compute[71692]:       <boot order="1"/>
Apr 13 19:35:02 user nova-compute[71692]:     </disk>
Apr 13 19:35:02 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:35:02 user nova-compute[71692]:       <mac address="fa:16:3e:99:28:62"/>
Apr 13 19:35:02 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:35:02 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:35:02 user nova-compute[71692]:       <target dev="tap7d634c23-9e"/>
Apr 13 19:35:02 user nova-compute[71692]:     </interface>
Apr 13 19:35:02 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:35:02 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/console.log" append="off"/>
Apr 13 19:35:02 user nova-compute[71692]:     </serial>
Apr 13 19:35:02 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:35:02 user nova-compute[71692]:     <video>
Apr 13 19:35:02 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:35:02 user nova-compute[71692]:     </video>
Apr 13 19:35:02 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:35:02 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:35:02 user nova-compute[71692]:     </rng>
Apr 13 19:35:02 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:35:02 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:35:02 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:35:02 user nova-compute[71692]:     </memballoon>
Apr 13 19:35:02 user nova-compute[71692]:   </devices>
Apr 13 19:35:02 user nova-compute[71692]: </domain>
Apr 13 19:35:02 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:35:02 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Instance destroyed successfully.
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:35:02 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] No VIF found with MAC fa:16:3e:99:28:62, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:35:03 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:35:03 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:35:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:35:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Didn't find any instances for network info cache update. {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 19:35:03 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:35:04 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:35:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-4fe4b912-75f4-4a93-aed7-eb385283f9bd req-5efcc3da-2275-46cc-ad2c-7e42734eb0e9 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:35:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4fe4b912-75f4-4a93-aed7-eb385283f9bd req-5efcc3da-2275-46cc-ad2c-7e42734eb0e9 service nova] Acquiring lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:35:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4fe4b912-75f4-4a93-aed7-eb385283f9bd req-5efcc3da-2275-46cc-ad2c-7e42734eb0e9 service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:35:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-4fe4b912-75f4-4a93-aed7-eb385283f9bd req-5efcc3da-2275-46cc-ad2c-7e42734eb0e9 service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:35:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-4fe4b912-75f4-4a93-aed7-eb385283f9bd req-5efcc3da-2275-46cc-ad2c-7e42734eb0e9 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] No waiting events found dispatching network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:35:04 user nova-compute[71692]: WARNING nova.compute.manager [req-4fe4b912-75f4-4a93-aed7-eb385283f9bd req-5efcc3da-2275-46cc-ad2c-7e42734eb0e9 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received unexpected event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e for instance with vm_state active and task_state rescuing.
Apr 13 19:35:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG nova.compute.manager [req-78c47cfb-6844-46d3-81f1-7e054441bb41 req-64ac8887-f93a-4b65-9170-8d580d9e619e service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Received event network-changed-35ecb629-90f6-4af1-b1fa-042bfb0cba8d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG nova.compute.manager [req-78c47cfb-6844-46d3-81f1-7e054441bb41 req-64ac8887-f93a-4b65-9170-8d580d9e619e service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Refreshing instance network info cache due to event network-changed-35ecb629-90f6-4af1-b1fa-042bfb0cba8d. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-78c47cfb-6844-46d3-81f1-7e054441bb41 req-64ac8887-f93a-4b65-9170-8d580d9e619e service nova] Acquiring lock "refresh_cache-f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-78c47cfb-6844-46d3-81f1-7e054441bb41 req-64ac8887-f93a-4b65-9170-8d580d9e619e service nova] Acquired lock "refresh_cache-f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG nova.network.neutron [req-78c47cfb-6844-46d3-81f1-7e054441bb41 req-64ac8887-f93a-4b65-9170-8d580d9e619e service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Refreshing network info cache for port 35ecb629-90f6-4af1-b1fa-042bfb0cba8d {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:35:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG nova.network.neutron [req-78c47cfb-6844-46d3-81f1-7e054441bb41 req-64ac8887-f93a-4b65-9170-8d580d9e619e service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Updated VIF entry in instance network info cache for port 35ecb629-90f6-4af1-b1fa-042bfb0cba8d. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG nova.network.neutron [req-78c47cfb-6844-46d3-81f1-7e054441bb41 req-64ac8887-f93a-4b65-9170-8d580d9e619e service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Updating instance_info_cache with network_info: [{"id": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "address": "fa:16:3e:99:96:34", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ecb629-90", "ovs_interfaceid": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-78c47cfb-6844-46d3-81f1-7e054441bb41 req-64ac8887-f93a-4b65-9170-8d580d9e619e service nova] Releasing lock "refresh_cache-f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Removed pending event for f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 due to event {{(pid=71692) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414506.6249552, f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:35:06 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] VM Resumed (Lifecycle Event)
Apr 13 19:35:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-987e5f1e-a281-486a-8eff-e10b05dd4a57 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-7a199c7d-66e2-468e-9a63-cb1e880961c6 req-5377bd95-73e9-4826-89e2-fcc344e786a4 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7a199c7d-66e2-468e-9a63-cb1e880961c6 req-5377bd95-73e9-4826-89e2-fcc344e786a4 service nova] Acquiring lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7a199c7d-66e2-468e-9a63-cb1e880961c6 req-5377bd95-73e9-4826-89e2-fcc344e786a4 service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7a199c7d-66e2-468e-9a63-cb1e880961c6 req-5377bd95-73e9-4826-89e2-fcc344e786a4 service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:35:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-7a199c7d-66e2-468e-9a63-cb1e880961c6 req-5377bd95-73e9-4826-89e2-fcc344e786a4 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] No waiting events found dispatching network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:35:06 user nova-compute[71692]: WARNING nova.compute.manager [req-7a199c7d-66e2-468e-9a63-cb1e880961c6 req-5377bd95-73e9-4826-89e2-fcc344e786a4 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received unexpected event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e for instance with vm_state active and task_state rescuing.
Apr 13 19:35:07 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 19:35:07 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414506.6255956, f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:35:07 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] VM Started (Lifecycle Event)
Apr 13 19:35:07 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:35:07 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:35:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8344MB free_disk=25.760299682617188GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 86893da2-3681-4a37-a6fc-1f56a2682070 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:35:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:35:08 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:35:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:35:11 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:35:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "7e331ffd-2171-44b4-a367-559a334ab52f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:35:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "7e331ffd-2171-44b4-a367-559a334ab52f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:35:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:35:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:35:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:35:11 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:35:11 user nova-compute[71692]: INFO nova.compute.claims [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Claim successful on node user
Apr 13 19:35:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:35:12 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:35:12 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:35:12 user nova-compute[71692]: INFO nova.virt.block_device [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Booting with volume 11e49275-fcba-44ff-a89f-406f93351219 at /dev/vda
Apr 13 19:35:12 user nova-compute[71692]: DEBUG os_brick.utils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcac76d4-093b-40ee-855f-e66f88603de4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:66cb688f7742\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0af225-aee4-464f-8eab-d3477da79f88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5756e44b-ad6a-4fe3-82fa-5c6011466293]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7af2a2-4b1e-4b58-b7fe-0465540559ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Running cmd (subprocess): nvme version {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] 'nvme version' failed. Not Retrying. {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG nova.policy [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '526d9c809b81418d89da662f973a1bdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5231d999e51417ebe91927707bfd2bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] nvme not present on system {{(pid=71692) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 19:35:12 user nova-compute[71692]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 19:35:12 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ff70ad-0334-4fd8-a8c5-49576e27c8d5]: (4, '') {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71692) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.lightos [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] LIGHTOS: no hostnqn found. {{(pid=71692) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG os_brick.utils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:66cb688f7742', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:35:12 user nova-compute[71692]: DEBUG nova.virt.block_device [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Updating existing volume attachment record: b582964d-6592-4b1b-8eeb-2c1aee8c2687 {{(pid=71692) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 19:35:13 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Successfully created port: 784e464c-9f0c-4e58-af49-905cf5ad0e31 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:35:13 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Successfully updated port: 784e464c-9f0c-4e58-af49-905cf5ad0e31 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:35:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "refresh_cache-7e331ffd-2171-44b4-a367-559a334ab52f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:35:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquired lock "refresh_cache-7e331ffd-2171-44b4-a367-559a334ab52f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:35:14 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:35:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-f98e8d55-cb94-4da9-ab78-b03d438f54d1 req-154f37d7-3c82-49b2-b350-5465b916b3bb service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Received event network-changed-784e464c-9f0c-4e58-af49-905cf5ad0e31 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:35:14 user nova-compute[71692]: DEBUG nova.compute.manager [req-f98e8d55-cb94-4da9-ab78-b03d438f54d1 req-154f37d7-3c82-49b2-b350-5465b916b3bb service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Refreshing instance network info cache due to event network-changed-784e464c-9f0c-4e58-af49-905cf5ad0e31. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:35:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f98e8d55-cb94-4da9-ab78-b03d438f54d1 req-154f37d7-3c82-49b2-b350-5465b916b3bb service nova] Acquiring lock "refresh_cache-7e331ffd-2171-44b4-a367-559a334ab52f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:35:14 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:35:14 user nova-compute[71692]: DEBUG nova.network.neutron [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Updating instance_info_cache with network_info: [{"id": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "address": "fa:16:3e:c6:20:73", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784e464c-9f", "ovs_interfaceid": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:35:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Releasing lock "refresh_cache-7e331ffd-2171-44b4-a367-559a334ab52f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:35:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Instance network_info: |[{"id": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "address": "fa:16:3e:c6:20:73", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784e464c-9f", "ovs_interfaceid": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:35:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f98e8d55-cb94-4da9-ab78-b03d438f54d1 req-154f37d7-3c82-49b2-b350-5465b916b3bb service nova] Acquired lock "refresh_cache-7e331ffd-2171-44b4-a367-559a334ab52f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:35:14 user nova-compute[71692]: DEBUG nova.network.neutron [req-f98e8d55-cb94-4da9-ab78-b03d438f54d1 req-154f37d7-3c82-49b2-b350-5465b916b3bb service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Refreshing network info cache for port 784e464c-9f0c-4e58-af49-905cf5ad0e31 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:35:14 user nova-compute[71692]: DEBUG nova.network.neutron [req-f98e8d55-cb94-4da9-ab78-b03d438f54d1 req-154f37d7-3c82-49b2-b350-5465b916b3bb service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Updated VIF entry in instance network info cache for port 784e464c-9f0c-4e58-af49-905cf5ad0e31. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:35:14 user nova-compute[71692]: DEBUG nova.network.neutron [req-f98e8d55-cb94-4da9-ab78-b03d438f54d1 req-154f37d7-3c82-49b2-b350-5465b916b3bb service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Updating instance_info_cache with network_info: [{"id": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "address": "fa:16:3e:c6:20:73", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784e464c-9f", "ovs_interfaceid": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:35:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-f98e8d55-cb94-4da9-ab78-b03d438f54d1 req-154f37d7-3c82-49b2-b350-5465b916b3bb service nova] Releasing lock "refresh_cache-7e331ffd-2171-44b4-a367-559a334ab52f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:35:17 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Creating image(s)
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Did not create local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Ensure instance console log exists: /opt/stack/data/nova/instances/7e331ffd-2171-44b4-a367-559a334ab52f/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Start _get_guest_xml network_info=[{"id": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "address": "fa:16:3e:c6:20:73", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784e464c-9f", "ovs_interfaceid": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'attachment_id': 'b582964d-6592-4b1b-8eeb-2c1aee8c2687', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmykcFbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7e331ffd-2171-44b4-a367-559a334ab52f', 'attached_at': '', 'detached_at': '', 'volume_id': '11e49275-fcba-44ff-a89f-406f93351219', 'serial': '11e49275-fcba-44ff-a89f-406f93351219'}, 'mount_device': '/dev/vda', 'guest_format': None, 'volume_type': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:35:17 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:35:17 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Calling os-brick to attach iSCSI Volume {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmykcFbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:35:17 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:35:17 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:35:17 user nova-compute[71692]: INFO os_brick.initiator.connectors.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dde6a2-9daa-4b26-a42e-3aeeb7bca6ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 19:35:17 user nova-compute[71692]:  {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --interface default --op new {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2987be5-fd97-4f48-b0e0-4a3164590f35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219] added\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219] added
Apr 13 19:35:17 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe1ac68-1f52-4e19-92a3-48273b76fd5e]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec719b59-9995-481a-ae33-f522431c52ba]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LmykcFbv {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LmykcFbv" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b93aa03-266f-4737-a22b-3abbc4f91981]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LmykcFbv'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d370d7b7-908b-4271-bdc9-ccf07193d54c]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12b8a15-a2ad-42ec-b70e-0dc84d107090]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:35:17 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:35:17 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:35:17 user nova-compute[71692]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d (non-flash)
Apr 13 19:35:17 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:35:17 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:35:17 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:35:17 user nova-compute[71692]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d (non-flash)
Apr 13 19:35:17 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --login {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dac2ce-b4c1-4fa8-8dfc-4e37ec6c4eab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219, portal: 172.16.0.220,3260]
Apr 13 19:35:17 user nova-compute[71692]: Login to [iface: default, target: iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219, portal: 172.16.0.220,3260] successful.
Apr 13 19:35:17 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e604774a-1d19-44fa-b8a3-6bc90fab3e37]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7b9277-ca4e-4cf0-a90b-973ba718b28a]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:35:17 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:35:17 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:35:17 user nova-compute[71692]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d (non-flash)
Apr 13 19:35:17 user nova-compute[71692]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 (non-flash)
Apr 13 19:35:17 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:35:17 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:35:17 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:35:17 user nova-compute[71692]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d (non-flash)
Apr 13 19:35:17 user nova-compute[71692]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 (non-flash)
Apr 13 19:35:17 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Connected to 172.16.0.220:3260 {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] HCTL ('37', '-', '-', 0) found on session 54 with lun 0 {{(pid=71692) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71692) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d89bad7-c7ec-4e67-b6c1-102edce45557]: (4, ('- - 0', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:35:17 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Searching for a device in session 54 and hctl ['37', '*', '*', 0] yield: None {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Searching for a device in session 54 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71692) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmykcFbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71692) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23662646236373739', 'path': '/dev/sdf'} {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662646236373739', 'path': '/dev/sdf'} {{(pid=71692) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1007669840',display_name='tempest-TestVolumeBootPattern-server-1007669840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1007669840',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj7TcL9FU0ycuamYqYTfleaq2m4r0SEirSHRlkPBcG/eCMlwnGnrLneKNOsIY4WhqDyz6ZvULFdimsQ4U+9lxxBdfuyuTJJKa1K6nRrg6kFRx2pkuS1DtxEUpZtRdywRA==',key_name='tempest-TestVolumeBootPattern-1410205426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-o886uhy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:35:12Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=7e331ffd-2171-44b4-a367-559a334ab52f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "address": "fa:16:3e:c6:20:73", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784e464c-9f", "ovs_interfaceid": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "address": "fa:16:3e:c6:20:73", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784e464c-9f", "ovs_interfaceid": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:20:73,bridge_name='br-int',has_traffic_filtering=True,id=784e464c-9f0c-4e58-af49-905cf5ad0e31,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784e464c-9f') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG nova.objects.instance [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e331ffd-2171-44b4-a367-559a334ab52f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:35:18 user nova-compute[71692]:   <uuid>7e331ffd-2171-44b4-a367-559a334ab52f</uuid>
Apr 13 19:35:18 user nova-compute[71692]:   <name>instance-0000002e</name>
Apr 13 19:35:18 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:35:18 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:35:18 user nova-compute[71692]:   <metadata>
Apr 13 19:35:18 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:35:18 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:35:18 user nova-compute[71692]:       <nova:name>tempest-TestVolumeBootPattern-server-1007669840</nova:name>
Apr 13 19:35:18 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:35:17</nova:creationTime>
Apr 13 19:35:18 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:35:18 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:35:18 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:35:18 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:35:18 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:35:18 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:35:18 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:35:18 user nova-compute[71692]:       <nova:owner>
Apr 13 19:35:18 user nova-compute[71692]:         <nova:user uuid="526d9c809b81418d89da662f973a1bdc">tempest-TestVolumeBootPattern-1717000141-project-member</nova:user>
Apr 13 19:35:18 user nova-compute[71692]:         <nova:project uuid="a5231d999e51417ebe91927707bfd2bd">tempest-TestVolumeBootPattern-1717000141</nova:project>
Apr 13 19:35:18 user nova-compute[71692]:       </nova:owner>
Apr 13 19:35:18 user nova-compute[71692]:       <nova:ports>
Apr 13 19:35:18 user nova-compute[71692]:         <nova:port uuid="784e464c-9f0c-4e58-af49-905cf5ad0e31">
Apr 13 19:35:18 user nova-compute[71692]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 19:35:18 user nova-compute[71692]:         </nova:port>
Apr 13 19:35:18 user nova-compute[71692]:       </nova:ports>
Apr 13 19:35:18 user nova-compute[71692]:     </nova:instance>
Apr 13 19:35:18 user nova-compute[71692]:   </metadata>
Apr 13 19:35:18 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:35:18 user nova-compute[71692]:     <system>
Apr 13 19:35:18 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:35:18 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:35:18 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:35:18 user nova-compute[71692]:       <entry name="serial">7e331ffd-2171-44b4-a367-559a334ab52f</entry>
Apr 13 19:35:18 user nova-compute[71692]:       <entry name="uuid">7e331ffd-2171-44b4-a367-559a334ab52f</entry>
Apr 13 19:35:18 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:35:18 user nova-compute[71692]:     </system>
Apr 13 19:35:18 user nova-compute[71692]:   </sysinfo>
Apr 13 19:35:18 user nova-compute[71692]:   <os>
Apr 13 19:35:18 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:35:18 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:35:18 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:35:18 user nova-compute[71692]:   </os>
Apr 13 19:35:18 user nova-compute[71692]:   <features>
Apr 13 19:35:18 user nova-compute[71692]:     <acpi/>
Apr 13 19:35:18 user nova-compute[71692]:     <apic/>
Apr 13 19:35:18 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:35:18 user nova-compute[71692]:   </features>
Apr 13 19:35:18 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:35:18 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:35:18 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:35:18 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:35:18 user nova-compute[71692]:   </clock>
Apr 13 19:35:18 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:35:18 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:35:18 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:35:18 user nova-compute[71692]:   </cpu>
Apr 13 19:35:18 user nova-compute[71692]:   <devices>
Apr 13 19:35:18 user nova-compute[71692]:     <disk type="block" device="disk">
Apr 13 19:35:18 user nova-compute[71692]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:35:18 user nova-compute[71692]:       <source dev="/dev/sdf"/>
Apr 13 19:35:18 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:35:18 user nova-compute[71692]:       <serial>11e49275-fcba-44ff-a89f-406f93351219</serial>
Apr 13 19:35:18 user nova-compute[71692]:     </disk>
Apr 13 19:35:18 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:35:18 user nova-compute[71692]:       <mac address="fa:16:3e:c6:20:73"/>
Apr 13 19:35:18 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:35:18 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:35:18 user nova-compute[71692]:       <target dev="tap784e464c-9f"/>
Apr 13 19:35:18 user nova-compute[71692]:     </interface>
Apr 13 19:35:18 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:35:18 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/7e331ffd-2171-44b4-a367-559a334ab52f/console.log" append="off"/>
Apr 13 19:35:18 user nova-compute[71692]:     </serial>
Apr 13 19:35:18 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:35:18 user nova-compute[71692]:     <video>
Apr 13 19:35:18 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:35:18 user nova-compute[71692]:     </video>
Apr 13 19:35:18 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:35:18 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:35:18 user nova-compute[71692]:     </rng>
Apr 13 19:35:18 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:35:18 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:35:18 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:35:18 user nova-compute[71692]:     </memballoon>
Apr 13 19:35:18 user nova-compute[71692]:   </devices>
Apr 13 19:35:18 user nova-compute[71692]: </domain>
Apr 13 19:35:18 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1007669840',display_name='tempest-TestVolumeBootPattern-server-1007669840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1007669840',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj7TcL9FU0ycuamYqYTfleaq2m4r0SEirSHRlkPBcG/eCMlwnGnrLneKNOsIY4WhqDyz6ZvULFdimsQ4U+9lxxBdfuyuTJJKa1K6nRrg6kFRx2pkuS1DtxEUpZtRdywRA==',key_name='tempest-TestVolumeBootPattern-1410205426',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-o886uhy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:35:12Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=7e331ffd-2171-44b4-a367-559a334ab52f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "address": "fa:16:3e:c6:20:73", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784e464c-9f", "ovs_interfaceid": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "address": "fa:16:3e:c6:20:73", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784e464c-9f", "ovs_interfaceid": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:20:73,bridge_name='br-int',has_traffic_filtering=True,id=784e464c-9f0c-4e58-af49-905cf5ad0e31,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784e464c-9f') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG os_vif [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:20:73,bridge_name='br-int',has_traffic_filtering=True,id=784e464c-9f0c-4e58-af49-905cf5ad0e31,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784e464c-9f') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap784e464c-9f, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap784e464c-9f, col_values=(('external_ids', {'iface-id': '784e464c-9f0c-4e58-af49-905cf5ad0e31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:20:73', 'vm-uuid': '7e331ffd-2171-44b4-a367-559a334ab52f'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:18 user nova-compute[71692]: INFO os_vif [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:20:73,bridge_name='br-int',has_traffic_filtering=True,id=784e464c-9f0c-4e58-af49-905cf5ad0e31,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784e464c-9f')
Apr 13 19:35:18 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:35:18 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] No VIF found with MAC fa:16:3e:c6:20:73, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:35:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:20 user nova-compute[71692]: DEBUG nova.compute.manager [req-c779511f-e722-46fe-83a8-c2d1cb232a76 req-678653bf-835b-45c3-910b-027ad279bdd1 service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Received event network-vif-plugged-784e464c-9f0c-4e58-af49-905cf5ad0e31 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:35:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c779511f-e722-46fe-83a8-c2d1cb232a76 req-678653bf-835b-45c3-910b-027ad279bdd1 service nova] Acquiring lock "7e331ffd-2171-44b4-a367-559a334ab52f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:35:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c779511f-e722-46fe-83a8-c2d1cb232a76 req-678653bf-835b-45c3-910b-027ad279bdd1 service nova] Lock "7e331ffd-2171-44b4-a367-559a334ab52f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:35:20 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c779511f-e722-46fe-83a8-c2d1cb232a76 req-678653bf-835b-45c3-910b-027ad279bdd1 service nova] Lock "7e331ffd-2171-44b4-a367-559a334ab52f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:35:20 user nova-compute[71692]: DEBUG nova.compute.manager [req-c779511f-e722-46fe-83a8-c2d1cb232a76 req-678653bf-835b-45c3-910b-027ad279bdd1 service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] No waiting events found dispatching network-vif-plugged-784e464c-9f0c-4e58-af49-905cf5ad0e31 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:35:20 user nova-compute[71692]: WARNING nova.compute.manager [req-c779511f-e722-46fe-83a8-c2d1cb232a76 req-678653bf-835b-45c3-910b-027ad279bdd1 service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Received unexpected event network-vif-plugged-784e464c-9f0c-4e58-af49-905cf5ad0e31 for instance with vm_state building and task_state spawning.
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414522.0867684, 7e331ffd-2171-44b4-a367-559a334ab52f => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:35:22 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] VM Resumed (Lifecycle Event)
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:35:22 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Instance spawned successfully.
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:35:22 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414522.0900664, 7e331ffd-2171-44b4-a367-559a334ab52f => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:35:22 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] VM Started (Lifecycle Event)
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:35:22 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:35:22 user nova-compute[71692]: INFO nova.compute.manager [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Took 4.96 seconds to spawn the instance on the hypervisor.
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:35:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:22 user nova-compute[71692]: INFO nova.compute.manager [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Took 10.36 seconds to build instance.
Apr 13 19:35:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-e6ece2fe-b7f7-4ed4-8efb-294b33fc9188 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "7e331ffd-2171-44b4-a367-559a334ab52f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.451s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-02fa37d1-fbfa-4aa3-a0e8-5e3d2beec136 req-5b54c2c2-bf13-4404-ba1e-1828bfc7e424 service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Received event network-vif-plugged-784e464c-9f0c-4e58-af49-905cf5ad0e31 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:35:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-02fa37d1-fbfa-4aa3-a0e8-5e3d2beec136 req-5b54c2c2-bf13-4404-ba1e-1828bfc7e424 service nova] Acquiring lock "7e331ffd-2171-44b4-a367-559a334ab52f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:35:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-02fa37d1-fbfa-4aa3-a0e8-5e3d2beec136 req-5b54c2c2-bf13-4404-ba1e-1828bfc7e424 service nova] Lock "7e331ffd-2171-44b4-a367-559a334ab52f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:35:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-02fa37d1-fbfa-4aa3-a0e8-5e3d2beec136 req-5b54c2c2-bf13-4404-ba1e-1828bfc7e424 service nova] Lock "7e331ffd-2171-44b4-a367-559a334ab52f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:35:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-02fa37d1-fbfa-4aa3-a0e8-5e3d2beec136 req-5b54c2c2-bf13-4404-ba1e-1828bfc7e424 service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] No waiting events found dispatching network-vif-plugged-784e464c-9f0c-4e58-af49-905cf5ad0e31 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:35:22 user nova-compute[71692]: WARNING nova.compute.manager [req-02fa37d1-fbfa-4aa3-a0e8-5e3d2beec136 req-5b54c2c2-bf13-4404-ba1e-1828bfc7e424 service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Received unexpected event network-vif-plugged-784e464c-9f0c-4e58-af49-905cf5ad0e31 for instance with vm_state active and task_state None.
Apr 13 19:35:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:35:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:35:59 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:36:00 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:36:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:03 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:36:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:36:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 19:36:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:36:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:36:03 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:36:03 user nova-compute[71692]: DEBUG nova.objects.instance [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lazy-loading 'info_cache' on Instance uuid 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:36:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:03 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updating instance_info_cache with network_info: [{"id": "5bd81344-f669-49c6-897f-97510d86e77b", "address": "fa:16:3e:01:0c:f9", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd81344-f6", "ovs_interfaceid": "5bd81344-f669-49c6-897f-97510d86e77b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:36:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:36:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/disk.rescue --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:36:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:06 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:36:06 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:36:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8248MB free_disk=25.750083923339844GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:36:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:36:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:36:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:36:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:36:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:36:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 86893da2-3681-4a37-a6fc-1f56a2682070 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:36:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:36:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:36:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 7e331ffd-2171-44b4-a367-559a334ab52f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:36:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:36:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:36:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:07 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:36:07 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:36:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:36:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.400s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:36:08 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:36:08 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:36:08 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:36:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:13 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:36:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:36:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:36:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:36:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:36:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:18 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:36:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:36:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:36:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:36:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:36:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:33 user nova-compute[71692]: DEBUG nova.compute.manager [req-de12dfdb-8944-4808-82fa-920ea194b9d7 req-92ba3b39-7fb1-4ca9-afc9-9e15d6fdc718 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received event network-changed-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:36:33 user nova-compute[71692]: DEBUG nova.compute.manager [req-de12dfdb-8944-4808-82fa-920ea194b9d7 req-92ba3b39-7fb1-4ca9-afc9-9e15d6fdc718 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Refreshing instance network info cache due to event network-changed-c940609d-fa89-4382-ad90-bba2f3f551f3. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:36:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-de12dfdb-8944-4808-82fa-920ea194b9d7 req-92ba3b39-7fb1-4ca9-afc9-9e15d6fdc718 service nova] Acquiring lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:36:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-de12dfdb-8944-4808-82fa-920ea194b9d7 req-92ba3b39-7fb1-4ca9-afc9-9e15d6fdc718 service nova] Acquired lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:36:33 user nova-compute[71692]: DEBUG nova.network.neutron [req-de12dfdb-8944-4808-82fa-920ea194b9d7 req-92ba3b39-7fb1-4ca9-afc9-9e15d6fdc718 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Refreshing network info cache for port c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:36:34 user nova-compute[71692]: DEBUG nova.network.neutron [req-de12dfdb-8944-4808-82fa-920ea194b9d7 req-92ba3b39-7fb1-4ca9-afc9-9e15d6fdc718 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Updated VIF entry in instance network info cache for port c940609d-fa89-4382-ad90-bba2f3f551f3. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:36:34 user nova-compute[71692]: DEBUG nova.network.neutron [req-de12dfdb-8944-4808-82fa-920ea194b9d7 req-92ba3b39-7fb1-4ca9-afc9-9e15d6fdc718 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Updating instance_info_cache with network_info: [{"id": "c940609d-fa89-4382-ad90-bba2f3f551f3", "address": "fa:16:3e:27:ff:c3", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940609d-fa", "ovs_interfaceid": "c940609d-fa89-4382-ad90-bba2f3f551f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:36:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-de12dfdb-8944-4808-82fa-920ea194b9d7 req-92ba3b39-7fb1-4ca9-afc9-9e15d6fdc718 service nova] Releasing lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:36:34 user nova-compute[71692]: DEBUG nova.compute.manager [req-c571e3da-297c-4e03-949f-12d999f9abeb req-c64a0ac6-b1e7-4926-b2d6-3ca0b15bb48b service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received event network-changed-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:36:34 user nova-compute[71692]: DEBUG nova.compute.manager [req-c571e3da-297c-4e03-949f-12d999f9abeb req-c64a0ac6-b1e7-4926-b2d6-3ca0b15bb48b service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Refreshing instance network info cache due to event network-changed-c940609d-fa89-4382-ad90-bba2f3f551f3. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:36:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c571e3da-297c-4e03-949f-12d999f9abeb req-c64a0ac6-b1e7-4926-b2d6-3ca0b15bb48b service nova] Acquiring lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:36:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c571e3da-297c-4e03-949f-12d999f9abeb req-c64a0ac6-b1e7-4926-b2d6-3ca0b15bb48b service nova] Acquired lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:36:34 user nova-compute[71692]: DEBUG nova.network.neutron [req-c571e3da-297c-4e03-949f-12d999f9abeb req-c64a0ac6-b1e7-4926-b2d6-3ca0b15bb48b service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Refreshing network info cache for port c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:36:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "86893da2-3681-4a37-a6fc-1f56a2682070" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:36:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "86893da2-3681-4a37-a6fc-1f56a2682070" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:36:34 user nova-compute[71692]: INFO nova.compute.manager [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Detaching volume c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d
Apr 13 19:36:34 user nova-compute[71692]: INFO nova.virt.block_device [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Attempting to driver detach volume c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d from mountpoint /dev/vdb
Apr 13 19:36:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Attempting to detach device vdb from instance 86893da2-3681-4a37-a6fc-1f56a2682070 from the persistent domain config. {{(pid=71692) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 19:36:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:36:34 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:36:34 user nova-compute[71692]:   <source dev="/dev/sde"/>
Apr 13 19:36:34 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:36:34 user nova-compute[71692]:   <serial>c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d</serial>
Apr 13 19:36:34 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:36:34 user nova-compute[71692]: </disk>
Apr 13 19:36:34 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:36:34 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Successfully detached device vdb from instance 86893da2-3681-4a37-a6fc-1f56a2682070 from the persistent domain config.
Apr 13 19:36:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 86893da2-3681-4a37-a6fc-1f56a2682070 from the live domain config. {{(pid=71692) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 19:36:34 user nova-compute[71692]: DEBUG nova.virt.libvirt.guest [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 19:36:34 user nova-compute[71692]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 19:36:34 user nova-compute[71692]:   <source dev="/dev/sde"/>
Apr 13 19:36:34 user nova-compute[71692]:   <target dev="vdb" bus="virtio"/>
Apr 13 19:36:34 user nova-compute[71692]:   <serial>c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d</serial>
Apr 13 19:36:34 user nova-compute[71692]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 19:36:34 user nova-compute[71692]: </disk>
Apr 13 19:36:34 user nova-compute[71692]:  {{(pid=71692) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG nova.network.neutron [req-c571e3da-297c-4e03-949f-12d999f9abeb req-c64a0ac6-b1e7-4926-b2d6-3ca0b15bb48b service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Updated VIF entry in instance network info cache for port c940609d-fa89-4382-ad90-bba2f3f551f3. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG nova.network.neutron [req-c571e3da-297c-4e03-949f-12d999f9abeb req-c64a0ac6-b1e7-4926-b2d6-3ca0b15bb48b service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Updating instance_info_cache with network_info: [{"id": "c940609d-fa89-4382-ad90-bba2f3f551f3", "address": "fa:16:3e:27:ff:c3", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940609d-fa", "ovs_interfaceid": "c940609d-fa89-4382-ad90-bba2f3f551f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-c571e3da-297c-4e03-949f-12d999f9abeb req-c64a0ac6-b1e7-4926-b2d6-3ca0b15bb48b service nova] Releasing lock "refresh_cache-86893da2-3681-4a37-a6fc-1f56a2682070" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Received event <DeviceRemovedEvent: 1681414595.4133832, 86893da2-3681-4a37-a6fc-1f56a2682070 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71692) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 86893da2-3681-4a37-a6fc-1f56a2682070 {{(pid=71692) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 19:36:35 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Successfully detached device vdb from instance 86893da2-3681-4a37-a6fc-1f56a2682070 from the live domain config.
Apr 13 19:36:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LzcwYReQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:36:35 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac6d0e9-6f61-4a44-aba2-a2e05dcbc0a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:36:35 user nova-compute[71692]: No targets found.
Apr 13 19:36:35 user nova-compute[71692]: iSNS:
Apr 13 19:36:35 user nova-compute[71692]: No targets found.
Apr 13 19:36:35 user nova-compute[71692]: STATIC:
Apr 13 19:36:35 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d
Apr 13 19:36:35 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:36:35 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:36:35 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5
Apr 13 19:36:35 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:36:35 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:36:35 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258
Apr 13 19:36:35 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:36:35 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:36:35 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945
Apr 13 19:36:35 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:36:35 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:36:35 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219
Apr 13 19:36:35 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:36:35 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:36:35 user nova-compute[71692]: FIRMWARE:
Apr 13 19:36:35 user nova-compute[71692]: No targets found.
Apr 13 19:36:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:36:35 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:36:35 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce699e3-7289-424e-8721-01fc98c5a05d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7f470a-cca5-4b85-84a3-8518dc7904d4]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:36:35 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:36:35 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:36:35 user nova-compute[71692]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d (non-flash)
Apr 13 19:36:35 user nova-compute[71692]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 (non-flash)
Apr 13 19:36:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:36:35 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:36:35 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:36:35 user nova-compute[71692]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d (non-flash)
Apr 13 19:36:35 user nova-compute[71692]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 (non-flash)
Apr 13 19:36:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febcc259120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d'): ({'sde'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Removing single pathed devices sde {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eadf7c9-ac08-44c9-9bee-1bdeb5fba7e5]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9e4c57-332d-43df-afb9-6e51d1a69ea1]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Flushing IO for device /dev/sde {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[88af6357-20ac-4dde-9183-9df0f87005ae]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfd7fbc-816d-48da-8195-eceb7aee3dbd]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] SCSI volumes sde have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff02404-f894-47a1-9dd4-0604d63f2e43]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[170c5f19-25b9-4cfb-add2-4e347a12cbfc]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d, portal: 172.16.0.220,3260]
Apr 13 19:36:35 user nova-compute[71692]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d, portal: 172.16.0.220,3260] successful.
Apr 13 19:36:35 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c40ba6d4-9dc6-4f44-b9cd-2e26f5c9410d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bbee21-cad7-4dd1-822e-302fc9cb7f96]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] <== disconnect_volume: return (348ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:36:35 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:36:36 user nova-compute[71692]: DEBUG nova.objects.instance [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'flavor' on Instance uuid 86893da2-3681-4a37-a6fc-1f56a2682070 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:36:36 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-b6e34251-a193-4efd-b16e-ed93fd5a5604 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "86893da2-3681-4a37-a6fc-1f56a2682070" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.712s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:36:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:36:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:36:49 user nova-compute[71692]: INFO nova.compute.manager [None req-dc970347-91d3-4ac7-aa7e-e8990aca7309 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Unrescuing
Apr 13 19:36:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-dc970347-91d3-4ac7-aa7e-e8990aca7309 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "refresh_cache-f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:36:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-dc970347-91d3-4ac7-aa7e-e8990aca7309 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquired lock "refresh_cache-f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:36:49 user nova-compute[71692]: DEBUG nova.network.neutron [None req-dc970347-91d3-4ac7-aa7e-e8990aca7309 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:36:50 user nova-compute[71692]: DEBUG nova.network.neutron [None req-dc970347-91d3-4ac7-aa7e-e8990aca7309 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Updating instance_info_cache with network_info: [{"id": "7d634c23-9eff-4a07-8036-b5ddc748828e", "address": "fa:16:3e:99:28:62", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d634c23-9e", "ovs_interfaceid": "7d634c23-9eff-4a07-8036-b5ddc748828e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:36:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-dc970347-91d3-4ac7-aa7e-e8990aca7309 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Releasing lock "refresh_cache-f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:36:50 user nova-compute[71692]: DEBUG nova.objects.instance [None req-dc970347-91d3-4ac7-aa7e-e8990aca7309 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'flavor' on Instance uuid f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:36:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:50 user nova-compute[71692]: DEBUG nova.compute.manager [req-73501aaa-0401-4a68-bc63-2071b984a799 req-bb30953f-b8c3-46f3-8752-8c0776416d6f service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received event network-vif-unplugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:36:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-73501aaa-0401-4a68-bc63-2071b984a799 req-bb30953f-b8c3-46f3-8752-8c0776416d6f service nova] Acquiring lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:36:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-73501aaa-0401-4a68-bc63-2071b984a799 req-bb30953f-b8c3-46f3-8752-8c0776416d6f service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:36:50 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-73501aaa-0401-4a68-bc63-2071b984a799 req-bb30953f-b8c3-46f3-8752-8c0776416d6f service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:36:50 user nova-compute[71692]: DEBUG nova.compute.manager [req-73501aaa-0401-4a68-bc63-2071b984a799 req-bb30953f-b8c3-46f3-8752-8c0776416d6f service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] No waiting events found dispatching network-vif-unplugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:36:50 user nova-compute[71692]: WARNING nova.compute.manager [req-73501aaa-0401-4a68-bc63-2071b984a799 req-bb30953f-b8c3-46f3-8752-8c0776416d6f service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received unexpected event network-vif-unplugged-7d634c23-9eff-4a07-8036-b5ddc748828e for instance with vm_state rescued and task_state unrescuing.
Apr 13 19:36:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:50 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:51 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Instance destroyed successfully.
Apr 13 19:36:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:36:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] Acquiring lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:36:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:36:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:36:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] No waiting events found dispatching network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:36:53 user nova-compute[71692]: WARNING nova.compute.manager [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received unexpected event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e for instance with vm_state rescued and task_state unrescuing.
Apr 13 19:36:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:36:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] Acquiring lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:36:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:36:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:36:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] No waiting events found dispatching network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:36:53 user nova-compute[71692]: WARNING nova.compute.manager [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received unexpected event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e for instance with vm_state rescued and task_state unrescuing.
Apr 13 19:36:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:36:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] Acquiring lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:36:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:36:53 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:36:53 user nova-compute[71692]: DEBUG nova.compute.manager [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] No waiting events found dispatching network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:36:53 user nova-compute[71692]: WARNING nova.compute.manager [req-1773700a-09a7-42c4-b18e-5c63732c8f20 req-3166d6de-8f41-4926-bcab-5cabc07cb991 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received unexpected event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e for instance with vm_state rescued and task_state unrescuing.
Apr 13 19:36:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:54 user nova-compute[71692]: DEBUG nova.virt.libvirt.host [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Removed pending event for f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 due to event {{(pid=71692) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 19:36:54 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414614.4863236, f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:36:54 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] VM Resumed (Lifecycle Event)
Apr 13 19:36:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-dc970347-91d3-4ac7-aa7e-e8990aca7309 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:36:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:36:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:36:54 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 19:36:54 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414614.4872866, f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:36:54 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] VM Started (Lifecycle Event)
Apr 13 19:36:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:36:54 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:36:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:36:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:00 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:37:01 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:37:03 user nova-compute[71692]: DEBUG nova.compute.manager [req-dc8b1c1e-b8f8-4f56-9830-7b87cdd6dff9 req-faf816ab-5e3a-437b-92f0-b0b80bd7a4ec service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Received event network-changed-784e464c-9f0c-4e58-af49-905cf5ad0e31 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:37:03 user nova-compute[71692]: DEBUG nova.compute.manager [req-dc8b1c1e-b8f8-4f56-9830-7b87cdd6dff9 req-faf816ab-5e3a-437b-92f0-b0b80bd7a4ec service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Refreshing instance network info cache due to event network-changed-784e464c-9f0c-4e58-af49-905cf5ad0e31. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:37:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dc8b1c1e-b8f8-4f56-9830-7b87cdd6dff9 req-faf816ab-5e3a-437b-92f0-b0b80bd7a4ec service nova] Acquiring lock "refresh_cache-7e331ffd-2171-44b4-a367-559a334ab52f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:37:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dc8b1c1e-b8f8-4f56-9830-7b87cdd6dff9 req-faf816ab-5e3a-437b-92f0-b0b80bd7a4ec service nova] Acquired lock "refresh_cache-7e331ffd-2171-44b4-a367-559a334ab52f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:37:03 user nova-compute[71692]: DEBUG nova.network.neutron [req-dc8b1c1e-b8f8-4f56-9830-7b87cdd6dff9 req-faf816ab-5e3a-437b-92f0-b0b80bd7a4ec service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Refreshing network info cache for port 784e464c-9f0c-4e58-af49-905cf5ad0e31 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:37:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:37:03 user nova-compute[71692]: DEBUG nova.network.neutron [req-dc8b1c1e-b8f8-4f56-9830-7b87cdd6dff9 req-faf816ab-5e3a-437b-92f0-b0b80bd7a4ec service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Updated VIF entry in instance network info cache for port 784e464c-9f0c-4e58-af49-905cf5ad0e31. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:37:03 user nova-compute[71692]: DEBUG nova.network.neutron [req-dc8b1c1e-b8f8-4f56-9830-7b87cdd6dff9 req-faf816ab-5e3a-437b-92f0-b0b80bd7a4ec service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Updating instance_info_cache with network_info: [{"id": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "address": "fa:16:3e:c6:20:73", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784e464c-9f", "ovs_interfaceid": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:37:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-dc8b1c1e-b8f8-4f56-9830-7b87cdd6dff9 req-faf816ab-5e3a-437b-92f0-b0b80bd7a4ec service nova] Releasing lock "refresh_cache-7e331ffd-2171-44b4-a367-559a334ab52f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:37:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "7e331ffd-2171-44b4-a367-559a334ab52f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:37:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "7e331ffd-2171-44b4-a367-559a334ab52f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:37:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "7e331ffd-2171-44b4-a367-559a334ab52f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:37:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "7e331ffd-2171-44b4-a367-559a334ab52f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:37:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "7e331ffd-2171-44b4-a367-559a334ab52f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:37:04 user nova-compute[71692]: INFO nova.compute.manager [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Terminating instance
Apr 13 19:37:04 user nova-compute[71692]: DEBUG nova.compute.manager [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:37:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-13866f21-6e4b-414f-bd27-f9395f67ca10 req-dbb601f2-ff51-4520-a046-bc3484ea796b service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Received event network-vif-unplugged-784e464c-9f0c-4e58-af49-905cf5ad0e31 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:37:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-13866f21-6e4b-414f-bd27-f9395f67ca10 req-dbb601f2-ff51-4520-a046-bc3484ea796b service nova] Acquiring lock "7e331ffd-2171-44b4-a367-559a334ab52f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:37:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-13866f21-6e4b-414f-bd27-f9395f67ca10 req-dbb601f2-ff51-4520-a046-bc3484ea796b service nova] Lock "7e331ffd-2171-44b4-a367-559a334ab52f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:37:04 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-13866f21-6e4b-414f-bd27-f9395f67ca10 req-dbb601f2-ff51-4520-a046-bc3484ea796b service nova] Lock "7e331ffd-2171-44b4-a367-559a334ab52f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:37:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-13866f21-6e4b-414f-bd27-f9395f67ca10 req-dbb601f2-ff51-4520-a046-bc3484ea796b service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] No waiting events found dispatching network-vif-unplugged-784e464c-9f0c-4e58-af49-905cf5ad0e31 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:37:04 user nova-compute[71692]: DEBUG nova.compute.manager [req-13866f21-6e4b-414f-bd27-f9395f67ca10 req-dbb601f2-ff51-4520-a046-bc3484ea796b service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Received event network-vif-unplugged-784e464c-9f0c-4e58-af49-905cf5ad0e31 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:37:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:05 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Instance destroyed successfully.
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.objects.instance [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lazy-loading 'resources' on Instance uuid 7e331ffd-2171-44b4-a367-559a334ab52f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1007669840',display_name='tempest-TestVolumeBootPattern-server-1007669840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1007669840',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj7TcL9FU0ycuamYqYTfleaq2m4r0SEirSHRlkPBcG/eCMlwnGnrLneKNOsIY4WhqDyz6ZvULFdimsQ4U+9lxxBdfuyuTJJKa1K6nRrg6kFRx2pkuS1DtxEUpZtRdywRA==',key_name='tempest-TestVolumeBootPattern-1410205426',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:35:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-o886uhy9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:35:22Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=7e331ffd-2171-44b4-a367-559a334ab52f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "address": "fa:16:3e:c6:20:73", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784e464c-9f", "ovs_interfaceid": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "address": "fa:16:3e:c6:20:73", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784e464c-9f", "ovs_interfaceid": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:20:73,bridge_name='br-int',has_traffic_filtering=True,id=784e464c-9f0c-4e58-af49-905cf5ad0e31,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784e464c-9f') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_vif [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:20:73,bridge_name='br-int',has_traffic_filtering=True,id=784e464c-9f0c-4e58-af49-905cf5ad0e31,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784e464c-9f') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap784e464c-9f, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:37:05 user nova-compute[71692]: INFO os_vif [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:20:73,bridge_name='br-int',has_traffic_filtering=True,id=784e464c-9f0c-4e58-af49-905cf5ad0e31,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap784e464c-9f')
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmykcFbv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:37:05 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[021820ee-2732-4fb2-8e2f-4094f8cf894b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:37:05 user nova-compute[71692]: No targets found.
Apr 13 19:37:05 user nova-compute[71692]: iSNS:
Apr 13 19:37:05 user nova-compute[71692]: No targets found.
Apr 13 19:37:05 user nova-compute[71692]: STATIC:
Apr 13 19:37:05 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5
Apr 13 19:37:05 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:37:05 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:37:05 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258
Apr 13 19:37:05 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:37:05 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:37:05 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945
Apr 13 19:37:05 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:37:05 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:37:05 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219
Apr 13 19:37:05 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:37:05 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:37:05 user nova-compute[71692]: FIRMWARE:
Apr 13 19:37:05 user nova-compute[71692]: No targets found.
Apr 13 19:37:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:37:05 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:37:05 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4fd2ef-28bf-43c4-8165-89f5251fd25a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8140f1a2-f14a-495b-adf1-80cf299310c0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:37:05 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:37:05 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:37:05 user nova-compute[71692]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 (non-flash)
Apr 13 19:37:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:37:05 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:37:05 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:37:05 user nova-compute[71692]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 (non-flash)
Apr 13 19:37:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febd8bf4e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219'): ({'sdf'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Removing single pathed devices sdf {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b75cf8-9ac6-44ae-be6c-b068d527c937]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08c8f3d-bb6c-4df4-a8a6-ac70911460bf]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flushing IO for device /dev/sdf {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc04fdb-ebc4-4678-b48c-c2e9a397de38]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.compute.manager [req-02f44c01-609c-43d5-949d-00db3a31fc39 req-5dc7d688-ebfa-4803-b471-46afc9936aab service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Received event network-changed-784e464c-9f0c-4e58-af49-905cf5ad0e31 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.compute.manager [req-02f44c01-609c-43d5-949d-00db3a31fc39 req-5dc7d688-ebfa-4803-b471-46afc9936aab service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Refreshing instance network info cache due to event network-changed-784e464c-9f0c-4e58-af49-905cf5ad0e31. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-02f44c01-609c-43d5-949d-00db3a31fc39 req-5dc7d688-ebfa-4803-b471-46afc9936aab service nova] Acquiring lock "refresh_cache-7e331ffd-2171-44b4-a367-559a334ab52f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-02f44c01-609c-43d5-949d-00db3a31fc39 req-5dc7d688-ebfa-4803-b471-46afc9936aab service nova] Acquired lock "refresh_cache-7e331ffd-2171-44b4-a367-559a334ab52f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.network.neutron [req-02f44c01-609c-43d5-949d-00db3a31fc39 req-5dc7d688-ebfa-4803-b471-46afc9936aab service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Refreshing network info cache for port 784e464c-9f0c-4e58-af49-905cf5ad0e31 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ab1280-6906-4374-bcd6-e785ca6ded49]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] SCSI volumes sdf have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOfda1aa6e-6bdb677970c67571', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fda1aa6e', '/dev/disk/by-id/scsi-23662646236373739') {{(pid=82243) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 19:37:05 user nova-compute[71692]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOfda1aa6e-6bdb677970c67571
Apr 13 19:37:05 user nova-compute[71692]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_fda1aa6e
Apr 13 19:37:05 user nova-compute[71692]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23662646236373739
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[28755876-8db7-4165-b813-ce1642c24cfc]: (4, None) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e96395-9cd9-4c9c-9ef8-43813196a35d]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3965d06e-929c-46c4-8af5-3145a251f003]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219, portal: 172.16.0.220,3260]
Apr 13 19:37:05 user nova-compute[71692]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219, portal: 172.16.0.220,3260] successful.
Apr 13 19:37:05 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11e49275-fcba-44ff-a89f-406f93351219 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3920c7c1-55df-44b2-bb04-56164d991fbf]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== disconnect_volume: return (362ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:37:05 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Deleting instance files /opt/stack/data/nova/instances/7e331ffd-2171-44b4-a367-559a334ab52f_del
Apr 13 19:37:05 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Deletion of /opt/stack/data/nova/instances/7e331ffd-2171-44b4-a367-559a334ab52f_del complete
Apr 13 19:37:05 user nova-compute[71692]: INFO nova.compute.manager [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Updating instance_info_cache with network_info: [{"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-991871a0-3a4e-4014-b07f-3e8c49eeda5a" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.network.neutron [req-02f44c01-609c-43d5-949d-00db3a31fc39 req-5dc7d688-ebfa-4803-b471-46afc9936aab service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Updated VIF entry in instance network info cache for port 784e464c-9f0c-4e58-af49-905cf5ad0e31. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG nova.network.neutron [req-02f44c01-609c-43d5-949d-00db3a31fc39 req-5dc7d688-ebfa-4803-b471-46afc9936aab service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Updating instance_info_cache with network_info: [{"id": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "address": "fa:16:3e:c6:20:73", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap784e464c-9f", "ovs_interfaceid": "784e464c-9f0c-4e58-af49-905cf5ad0e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-02f44c01-609c-43d5-949d-00db3a31fc39 req-5dc7d688-ebfa-4803-b471-46afc9936aab service nova] Releasing lock "refresh_cache-7e331ffd-2171-44b4-a367-559a334ab52f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:37:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-0ef52671-c721-45bb-8097-aa89c7b769d1 req-8698acf4-af20-497a-938e-68a12e616307 service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Received event network-vif-plugged-784e464c-9f0c-4e58-af49-905cf5ad0e31 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0ef52671-c721-45bb-8097-aa89c7b769d1 req-8698acf4-af20-497a-938e-68a12e616307 service nova] Acquiring lock "7e331ffd-2171-44b4-a367-559a334ab52f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0ef52671-c721-45bb-8097-aa89c7b769d1 req-8698acf4-af20-497a-938e-68a12e616307 service nova] Lock "7e331ffd-2171-44b4-a367-559a334ab52f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-0ef52671-c721-45bb-8097-aa89c7b769d1 req-8698acf4-af20-497a-938e-68a12e616307 service nova] Lock "7e331ffd-2171-44b4-a367-559a334ab52f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG nova.compute.manager [req-0ef52671-c721-45bb-8097-aa89c7b769d1 req-8698acf4-af20-497a-938e-68a12e616307 service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] No waiting events found dispatching network-vif-plugged-784e464c-9f0c-4e58-af49-905cf5ad0e31 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:37:06 user nova-compute[71692]: WARNING nova.compute.manager [req-0ef52671-c721-45bb-8097-aa89c7b769d1 req-8698acf4-af20-497a-938e-68a12e616307 service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Received unexpected event network-vif-plugged-784e464c-9f0c-4e58-af49-905cf5ad0e31 for instance with vm_state active and task_state deleting.
Apr 13 19:37:06 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Took 1.08 seconds to deallocate network for instance.
Apr 13 19:37:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:37:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:07 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:37:07 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:37:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8303MB free_disk=25.748607635498047GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 86893da2-3681-4a37-a6fc-1f56a2682070 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 7e331ffd-2171-44b4-a367-559a334ab52f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:37:07 user nova-compute[71692]: INFO nova.compute.manager [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Took 0.95 seconds to detach 1 volumes for instance.
Apr 13 19:37:07 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.021s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:37:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:37:07 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Deleted allocations for instance 7e331ffd-2171-44b4-a367-559a334ab52f
Apr 13 19:37:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-9faeebd3-2254-41ee-a76c-b4419b94ed89 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "7e331ffd-2171-44b4-a367-559a334ab52f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.682s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:37:08 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:37:08 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:37:08 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:37:08 user nova-compute[71692]: DEBUG nova.compute.manager [req-2292a825-5cba-4099-96d0-18e023e4e70c req-fa6f4fdf-72d4-4059-a2a4-8b3dd052cf77 service nova] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Received event network-vif-deleted-784e464c-9f0c-4e58-af49-905cf5ad0e31 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:37:09 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:37:09 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:37:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:15 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:37:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:20 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681414625.1131682, 7e331ffd-2171-44b4-a367-559a334ab52f => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:37:20 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] VM Stopped (Lifecycle Event)
Apr 13 19:37:20 user nova-compute[71692]: DEBUG nova.compute.manager [None req-327cec50-180a-4f04-9c36-ba0c0b5075ad None None] [instance: 7e331ffd-2171-44b4-a367-559a334ab52f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:37:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "86893da2-3681-4a37-a6fc-1f56a2682070" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:37:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "86893da2-3681-4a37-a6fc-1f56a2682070" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:37:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:37:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:37:27 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:37:27 user nova-compute[71692]: INFO nova.compute.manager [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Terminating instance
Apr 13 19:37:27 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:37:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:28 user nova-compute[71692]: DEBUG nova.compute.manager [req-9b1a68f7-ffaf-40b5-9485-a3f4673ff053 req-5df5cd8b-7d7a-48d2-8fea-7fce04c88239 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received event network-vif-unplugged-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:37:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9b1a68f7-ffaf-40b5-9485-a3f4673ff053 req-5df5cd8b-7d7a-48d2-8fea-7fce04c88239 service nova] Acquiring lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:37:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9b1a68f7-ffaf-40b5-9485-a3f4673ff053 req-5df5cd8b-7d7a-48d2-8fea-7fce04c88239 service nova] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:37:28 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-9b1a68f7-ffaf-40b5-9485-a3f4673ff053 req-5df5cd8b-7d7a-48d2-8fea-7fce04c88239 service nova] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:37:28 user nova-compute[71692]: DEBUG nova.compute.manager [req-9b1a68f7-ffaf-40b5-9485-a3f4673ff053 req-5df5cd8b-7d7a-48d2-8fea-7fce04c88239 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] No waiting events found dispatching network-vif-unplugged-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:37:28 user nova-compute[71692]: DEBUG nova.compute.manager [req-9b1a68f7-ffaf-40b5-9485-a3f4673ff053 req-5df5cd8b-7d7a-48d2-8fea-7fce04c88239 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received event network-vif-unplugged-c940609d-fa89-4382-ad90-bba2f3f551f3 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:37:28 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Instance destroyed successfully.
Apr 13 19:37:28 user nova-compute[71692]: DEBUG nova.objects.instance [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lazy-loading 'resources' on Instance uuid 86893da2-3681-4a37-a6fc-1f56a2682070 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:37:28 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:32:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1642739098',display_name='tempest-TestMinimumBasicScenario-server-1642739098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1642739098',id=43,image_ref='757ffc78-56f8-4b5c-b83d-33fa99678d59',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwcqpuDDwnFCEHILsu3WkKfw+2MVJkUkNLRq/o7hP6qLuVniwQ8/8OV7G92m5CXMJVOwwdyf9OuSgpmCn7j4zLzXlUPSwq2Fys9p4c7O5dwLlZB/zevuX8VkzU1GXk55A==',key_name='tempest-TestMinimumBasicScenario-717246144',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:32:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba0e42217cc44413951d6d5a87dbb886',ramdisk_id='',reservation_id='r-5jbkdfgi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='757ffc78-56f8-4b5c-b83d-33fa99678d59',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-8202894',owner_user_name='tempest-TestMinimumBasicScenario-8202894-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:34:50Z,user_data=None,user_id='9b9ed2da2b4949269c2df77766a1835f',uuid=86893da2-3681-4a37-a6fc-1f56a2682070,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c940609d-fa89-4382-ad90-bba2f3f551f3", "address": "fa:16:3e:27:ff:c3", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940609d-fa", "ovs_interfaceid": "c940609d-fa89-4382-ad90-bba2f3f551f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:37:28 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converting VIF {"id": "c940609d-fa89-4382-ad90-bba2f3f551f3", "address": "fa:16:3e:27:ff:c3", "network": {"id": "2b40b836-544b-4e28-9672-0a59d4b98271", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-327523839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba0e42217cc44413951d6d5a87dbb886", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940609d-fa", "ovs_interfaceid": "c940609d-fa89-4382-ad90-bba2f3f551f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:37:28 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=c940609d-fa89-4382-ad90-bba2f3f551f3,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc940609d-fa') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:37:28 user nova-compute[71692]: DEBUG os_vif [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=c940609d-fa89-4382-ad90-bba2f3f551f3,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc940609d-fa') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:37:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc940609d-fa, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:37:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:28 user nova-compute[71692]: INFO os_vif [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:ff:c3,bridge_name='br-int',has_traffic_filtering=True,id=c940609d-fa89-4382-ad90-bba2f3f551f3,network=Network(2b40b836-544b-4e28-9672-0a59d4b98271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc940609d-fa')
Apr 13 19:37:28 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Deleting instance files /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070_del
Apr 13 19:37:28 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Deletion of /opt/stack/data/nova/instances/86893da2-3681-4a37-a6fc-1f56a2682070_del complete
Apr 13 19:37:28 user nova-compute[71692]: INFO nova.compute.manager [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 13 19:37:28 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:37:28 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:37:28 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:37:29 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:37:29 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Took 0.47 seconds to deallocate network for instance.
Apr 13 19:37:29 user nova-compute[71692]: DEBUG nova.compute.manager [req-7d505442-e045-46e0-95b4-0805ecc39733 req-5e5733f9-09a8-498f-bd12-4062d70575d4 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received event network-vif-deleted-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:37:29 user nova-compute[71692]: INFO nova.compute.manager [req-7d505442-e045-46e0-95b4-0805ecc39733 req-5e5733f9-09a8-498f-bd12-4062d70575d4 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Neutron deleted interface c940609d-fa89-4382-ad90-bba2f3f551f3; detaching it from the instance and deleting it from the info cache
Apr 13 19:37:29 user nova-compute[71692]: DEBUG nova.network.neutron [req-7d505442-e045-46e0-95b4-0805ecc39733 req-5e5733f9-09a8-498f-bd12-4062d70575d4 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:37:29 user nova-compute[71692]: DEBUG nova.compute.manager [req-7d505442-e045-46e0-95b4-0805ecc39733 req-5e5733f9-09a8-498f-bd12-4062d70575d4 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Detach interface failed, port_id=c940609d-fa89-4382-ad90-bba2f3f551f3, reason: Instance 86893da2-3681-4a37-a6fc-1f56a2682070 could not be found. {{(pid=71692) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 19:37:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:37:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:37:29 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:37:29 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:37:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:37:29 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Deleted allocations for instance 86893da2-3681-4a37-a6fc-1f56a2682070
Apr 13 19:37:29 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d4dedb91-6a5c-4a08-8e83-839a8b3b1712 tempest-TestMinimumBasicScenario-8202894 tempest-TestMinimumBasicScenario-8202894-project-member] Lock "86893da2-3681-4a37-a6fc-1f56a2682070" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.707s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:37:30 user nova-compute[71692]: DEBUG nova.compute.manager [req-939c6ae5-b4b8-4273-be14-22b0cc2cc55a req-523a60ac-f850-496a-932f-8d7cfcd15453 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received event network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:37:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-939c6ae5-b4b8-4273-be14-22b0cc2cc55a req-523a60ac-f850-496a-932f-8d7cfcd15453 service nova] Acquiring lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:37:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-939c6ae5-b4b8-4273-be14-22b0cc2cc55a req-523a60ac-f850-496a-932f-8d7cfcd15453 service nova] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:37:30 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-939c6ae5-b4b8-4273-be14-22b0cc2cc55a req-523a60ac-f850-496a-932f-8d7cfcd15453 service nova] Lock "86893da2-3681-4a37-a6fc-1f56a2682070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:37:30 user nova-compute[71692]: DEBUG nova.compute.manager [req-939c6ae5-b4b8-4273-be14-22b0cc2cc55a req-523a60ac-f850-496a-932f-8d7cfcd15453 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] No waiting events found dispatching network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:37:30 user nova-compute[71692]: WARNING nova.compute.manager [req-939c6ae5-b4b8-4273-be14-22b0cc2cc55a req-523a60ac-f850-496a-932f-8d7cfcd15453 service nova] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Received unexpected event network-vif-plugged-c940609d-fa89-4382-ad90-bba2f3f551f3 for instance with vm_state deleted and task_state None.
Apr 13 19:37:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:43 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681414648.5546012, 86893da2-3681-4a37-a6fc-1f56a2682070 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:37:43 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] VM Stopped (Lifecycle Event)
Apr 13 19:37:43 user nova-compute[71692]: DEBUG nova.compute.manager [None req-7b85574b-4527-40a2-9bc6-0c092d720905 None None] [instance: 86893da2-3681-4a37-a6fc-1f56a2682070] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:37:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:37:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:37:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:37:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:37:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-8f6568d5-298f-49bd-98a6-e7de64ea6604 req-5d68678c-aaad-4208-aa08-6ed1edafef6d service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Received event network-changed-35ecb629-90f6-4af1-b1fa-042bfb0cba8d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:37:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-8f6568d5-298f-49bd-98a6-e7de64ea6604 req-5d68678c-aaad-4208-aa08-6ed1edafef6d service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Refreshing instance network info cache due to event network-changed-35ecb629-90f6-4af1-b1fa-042bfb0cba8d. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:37:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8f6568d5-298f-49bd-98a6-e7de64ea6604 req-5d68678c-aaad-4208-aa08-6ed1edafef6d service nova] Acquiring lock "refresh_cache-f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:37:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8f6568d5-298f-49bd-98a6-e7de64ea6604 req-5d68678c-aaad-4208-aa08-6ed1edafef6d service nova] Acquired lock "refresh_cache-f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:37:59 user nova-compute[71692]: DEBUG nova.network.neutron [req-8f6568d5-298f-49bd-98a6-e7de64ea6604 req-5d68678c-aaad-4208-aa08-6ed1edafef6d service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Refreshing network info cache for port 35ecb629-90f6-4af1-b1fa-042bfb0cba8d {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:37:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:37:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:37:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:37:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:37:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:37:59 user nova-compute[71692]: INFO nova.compute.manager [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Terminating instance
Apr 13 19:37:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-ed7d717b-66aa-40e9-be60-350181ce068e req-52fd7d3a-c0d4-4e58-9207-a10a5ca315d4 service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Received event network-vif-unplugged-35ecb629-90f6-4af1-b1fa-042bfb0cba8d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ed7d717b-66aa-40e9-be60-350181ce068e req-52fd7d3a-c0d4-4e58-9207-a10a5ca315d4 service nova] Acquiring lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ed7d717b-66aa-40e9-be60-350181ce068e req-52fd7d3a-c0d4-4e58-9207-a10a5ca315d4 service nova] Lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-ed7d717b-66aa-40e9-be60-350181ce068e req-52fd7d3a-c0d4-4e58-9207-a10a5ca315d4 service nova] Lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-ed7d717b-66aa-40e9-be60-350181ce068e req-52fd7d3a-c0d4-4e58-9207-a10a5ca315d4 service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] No waiting events found dispatching network-vif-unplugged-35ecb629-90f6-4af1-b1fa-042bfb0cba8d {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG nova.compute.manager [req-ed7d717b-66aa-40e9-be60-350181ce068e req-52fd7d3a-c0d4-4e58-9207-a10a5ca315d4 service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Received event network-vif-unplugged-35ecb629-90f6-4af1-b1fa-042bfb0cba8d for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG nova.network.neutron [req-8f6568d5-298f-49bd-98a6-e7de64ea6604 req-5d68678c-aaad-4208-aa08-6ed1edafef6d service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Updated VIF entry in instance network info cache for port 35ecb629-90f6-4af1-b1fa-042bfb0cba8d. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG nova.network.neutron [req-8f6568d5-298f-49bd-98a6-e7de64ea6604 req-5d68678c-aaad-4208-aa08-6ed1edafef6d service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Updating instance_info_cache with network_info: [{"id": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "address": "fa:16:3e:99:96:34", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ecb629-90", "ovs_interfaceid": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-8f6568d5-298f-49bd-98a6-e7de64ea6604 req-5d68678c-aaad-4208-aa08-6ed1edafef6d service nova] Releasing lock "refresh_cache-f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:38:00 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Instance destroyed successfully.
Apr 13 19:38:00 user nova-compute[71692]: DEBUG nova.objects.instance [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lazy-loading 'resources' on Instance uuid f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1195708667',display_name='tempest-TestVolumeBootPattern-server-1195708667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1195708667',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNj7TcL9FU0ycuamYqYTfleaq2m4r0SEirSHRlkPBcG/eCMlwnGnrLneKNOsIY4WhqDyz6ZvULFdimsQ4U+9lxxBdfuyuTJJKa1K6nRrg6kFRx2pkuS1DtxEUpZtRdywRA==',key_name='tempest-TestVolumeBootPattern-1410205426',keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:33:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5231d999e51417ebe91927707bfd2bd',ramdisk_id='',reservation_id='r-bgkdcv4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1717000141',owner_user_name='tempest-TestVolumeBootPattern-1717000141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:33:26Z,user_data=None,user_id='526d9c809b81418d89da662f973a1bdc',uuid=f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "address": "fa:16:3e:99:96:34", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ecb629-90", "ovs_interfaceid": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converting VIF {"id": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "address": "fa:16:3e:99:96:34", "network": {"id": "824b1924-526b-40ac-95d3-6927aa9656c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-208865966-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5231d999e51417ebe91927707bfd2bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35ecb629-90", "ovs_interfaceid": "35ecb629-90f6-4af1-b1fa-042bfb0cba8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:96:34,bridge_name='br-int',has_traffic_filtering=True,id=35ecb629-90f6-4af1-b1fa-042bfb0cba8d,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ecb629-90') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG os_vif [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:96:34,bridge_name='br-int',has_traffic_filtering=True,id=35ecb629-90f6-4af1-b1fa-042bfb0cba8d,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ecb629-90') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35ecb629-90, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:38:00 user nova-compute[71692]: INFO os_vif [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:96:34,bridge_name='br-int',has_traffic_filtering=True,id=35ecb629-90f6-4af1-b1fa-042bfb0cba8d,network=Network(824b1924-526b-40ac-95d3-6927aa9656c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35ecb629-90')
Apr 13 19:38:00 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qZFKraEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:38:00 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:38:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8d42ff-d84b-49ce-a82b-82f996e31381]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:38:00 user nova-compute[71692]: No targets found.
Apr 13 19:38:00 user nova-compute[71692]: iSNS:
Apr 13 19:38:00 user nova-compute[71692]: No targets found.
Apr 13 19:38:00 user nova-compute[71692]: STATIC:
Apr 13 19:38:00 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5
Apr 13 19:38:00 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:38:00 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:38:00 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258
Apr 13 19:38:00 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:38:00 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:38:00 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945
Apr 13 19:38:00 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:38:00 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:38:00 user nova-compute[71692]: FIRMWARE:
Apr 13 19:38:00 user nova-compute[71692]: No targets found.
Apr 13 19:38:00 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:38:00 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:38:00 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[a428a125-d0c6-48f7-853c-b9f0fe7cf489]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b3a83f-673a-4a1d-af52-d3bb763e3fbf]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:38:00 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:38:00 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:38:00 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:38:00 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:38:00 user nova-compute[71692]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 (non-flash)
Apr 13 19:38:00 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feba055ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5'): ({'sdd'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Removing single pathed devices sdd {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0b637c-d3b0-4a64-8999-ade465bac3b5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[da78ed59-6006-4969-b3b2-6c116eb1230c]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Flushing IO for device /dev/sdd {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[e819748e-6fe4-4f5d-a49b-958709deb294]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:38:00 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[903c598a-2663-4417-a55f-93d71d6a11ed]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] SCSI volumes sdd have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3668af43-6efc5c4aaa74b112', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3668af43', '/dev/disk/by-id/scsi-23665666335633461') {{(pid=82243) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d41bc57-3947-4f24-9c27-c26a7595464e]: (4, None) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d47ca9-0a94-41bd-8bb7-dac3f564f4ab]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c87d2aa-2201-4a61-afa7-ef97f0ce9914]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5, portal: 172.16.0.220,3260]
Apr 13 19:38:01 user nova-compute[71692]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5, portal: 172.16.0.220,3260] successful.
Apr 13 19:38:01 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:859d56a6-4c86-402c-9b6c-564c027c53d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bf59e3-3acd-4ae0-b850-c86594c34bb7]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] <== disconnect_volume: return (331ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:38:01 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Deleting instance files /opt/stack/data/nova/instances/f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c_del
Apr 13 19:38:01 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Deletion of /opt/stack/data/nova/instances/f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c_del complete
Apr 13 19:38:01 user nova-compute[71692]: INFO nova.compute.manager [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 13 19:38:01 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:38:01 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:38:01 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Took 0.50 seconds to deallocate network for instance.
Apr 13 19:38:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-a3b418d9-a35c-4a2d-90ab-3e60d72cadc8 req-49a0b374-1b84-4c1d-ae0b-8893f67b6daf service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Received event network-vif-deleted-35ecb629-90f6-4af1-b1fa-042bfb0cba8d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:38:02 user nova-compute[71692]: DEBUG nova.compute.manager [req-3716acc1-a472-478f-87b4-76f131c18447 req-3a77dcca-ae47-4b7c-accd-f6d893a51e7a service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Received event network-vif-plugged-35ecb629-90f6-4af1-b1fa-042bfb0cba8d {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:38:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3716acc1-a472-478f-87b4-76f131c18447 req-3a77dcca-ae47-4b7c-accd-f6d893a51e7a service nova] Acquiring lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:38:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3716acc1-a472-478f-87b4-76f131c18447 req-3a77dcca-ae47-4b7c-accd-f6d893a51e7a service nova] Lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:38:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3716acc1-a472-478f-87b4-76f131c18447 req-3a77dcca-ae47-4b7c-accd-f6d893a51e7a service nova] Lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:38:02 user nova-compute[71692]: DEBUG nova.compute.manager [req-3716acc1-a472-478f-87b4-76f131c18447 req-3a77dcca-ae47-4b7c-accd-f6d893a51e7a service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] No waiting events found dispatching network-vif-plugged-35ecb629-90f6-4af1-b1fa-042bfb0cba8d {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:38:02 user nova-compute[71692]: WARNING nova.compute.manager [req-3716acc1-a472-478f-87b4-76f131c18447 req-3a77dcca-ae47-4b7c-accd-f6d893a51e7a service nova] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Received unexpected event network-vif-plugged-35ecb629-90f6-4af1-b1fa-042bfb0cba8d for instance with vm_state active and task_state deleting.
Apr 13 19:38:02 user nova-compute[71692]: INFO nova.compute.manager [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Took 0.77 seconds to detach 1 volumes for instance.
Apr 13 19:38:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:38:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:38:02 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:38:02 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:38:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:38:02 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Deleted allocations for instance f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c
Apr 13 19:38:02 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-bc93469f-3d4f-46f1-8998-2bbaba218e91 tempest-TestVolumeBootPattern-1717000141 tempest-TestVolumeBootPattern-1717000141-project-member] Lock "f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.864s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:38:03 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Updating instance_info_cache with network_info: [{"id": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "address": "fa:16:3e:c5:4f:ac", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ac5520-b0", "ovs_interfaceid": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:06 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:06 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:38:06 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:38:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8536MB free_disk=25.767169952392578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:38:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:38:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:38:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:38:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:38:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:38:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:38:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:38:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:38:07 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing inventories for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 19:38:07 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating ProviderTree inventory for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 19:38:07 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating inventory in ProviderTree for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 19:38:07 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing aggregate associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, aggregates: None {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 19:38:07 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing trait associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 19:38:07 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:38:07 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:38:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:38:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:38:07 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:38:07 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:38:10 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:38:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:38:10 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:38:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:15 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681414680.7523692, f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:38:15 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] VM Stopped (Lifecycle Event)
Apr 13 19:38:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-3da08a73-872d-476c-a766-19fe40811682 None None] [instance: f292c8bc-f7bf-4c20-bf1a-cf398e9efa0c] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:38:15 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:16 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:38:16 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:38:16 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 19:38:18 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:38:18 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 19:38:18 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] There are 0 instances to clean {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 19:38:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:20 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:25 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:26 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:38:30 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:35 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:38:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:38:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:38:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:38:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:38:40 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:38:40 user nova-compute[71692]: INFO nova.compute.manager [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Terminating instance
Apr 13 19:38:40 user nova-compute[71692]: DEBUG nova.compute.manager [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:38:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:38:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:38:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:38:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:38:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:38:40 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-86b9b8d8-b0a1-4825-9e50-114565c4efe2 req-2f87c74a-0f8f-448b-9d77-2b7d459a1d46 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received event network-vif-unplugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-86b9b8d8-b0a1-4825-9e50-114565c4efe2 req-2f87c74a-0f8f-448b-9d77-2b7d459a1d46 service nova] Acquiring lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-86b9b8d8-b0a1-4825-9e50-114565c4efe2 req-2f87c74a-0f8f-448b-9d77-2b7d459a1d46 service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-86b9b8d8-b0a1-4825-9e50-114565c4efe2 req-2f87c74a-0f8f-448b-9d77-2b7d459a1d46 service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-86b9b8d8-b0a1-4825-9e50-114565c4efe2 req-2f87c74a-0f8f-448b-9d77-2b7d459a1d46 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] No waiting events found dispatching network-vif-unplugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG nova.compute.manager [req-86b9b8d8-b0a1-4825-9e50-114565c4efe2 req-2f87c74a-0f8f-448b-9d77-2b7d459a1d46 service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received event network-vif-unplugged-7d634c23-9eff-4a07-8036-b5ddc748828e for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:41 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Instance destroyed successfully.
Apr 13 19:38:41 user nova-compute[71692]: DEBUG nova.objects.instance [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'resources' on Instance uuid f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-613518771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-613518771',id=44,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:35:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c00a7fcd6d3040e8b2db0448eeda93ad',ramdisk_id='',reservation_id='r-acdbcv8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:36:55Z,user_data=None,user_id='dd604fa4d17b42b1abea8c2f2405b58d',uuid=f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d634c23-9eff-4a07-8036-b5ddc748828e", "address": "fa:16:3e:99:28:62", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d634c23-9e", "ovs_interfaceid": "7d634c23-9eff-4a07-8036-b5ddc748828e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converting VIF {"id": "7d634c23-9eff-4a07-8036-b5ddc748828e", "address": "fa:16:3e:99:28:62", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d634c23-9e", "ovs_interfaceid": "7d634c23-9eff-4a07-8036-b5ddc748828e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:28:62,bridge_name='br-int',has_traffic_filtering=True,id=7d634c23-9eff-4a07-8036-b5ddc748828e,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d634c23-9e') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_vif [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:28:62,bridge_name='br-int',has_traffic_filtering=True,id=7d634c23-9eff-4a07-8036-b5ddc748828e,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d634c23-9e') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d634c23-9e, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:38:41 user nova-compute[71692]: INFO os_vif [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:28:62,bridge_name='br-int',has_traffic_filtering=True,id=7d634c23-9eff-4a07-8036-b5ddc748828e,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d634c23-9e')
Apr 13 19:38:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgbNGHKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:38:41 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9861d072-3afc-486f-82e4-13e5cdd6dffe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:38:41 user nova-compute[71692]: No targets found.
Apr 13 19:38:41 user nova-compute[71692]: iSNS:
Apr 13 19:38:41 user nova-compute[71692]: No targets found.
Apr 13 19:38:41 user nova-compute[71692]: STATIC:
Apr 13 19:38:41 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258
Apr 13 19:38:41 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:38:41 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:38:41 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945
Apr 13 19:38:41 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:38:41 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:38:41 user nova-compute[71692]: FIRMWARE:
Apr 13 19:38:41 user nova-compute[71692]: No targets found.
Apr 13 19:38:41 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:38:41 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:38:41 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb755cd-3f91-4d75-9970-2460ce10c449]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebed957e-2427-4fea-afbe-90c889074387]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:38:41 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:38:41 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:38:41 user nova-compute[71692]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 (non-flash)
Apr 13 19:38:41 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7febc41d9c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258'): ({'sdc'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Removing single pathed devices sdc {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a07cee8-6fdd-4e49-8eff-89ba71e739de]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a04b957-812f-4271-9c01-fdc87cf40371]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flushing IO for device /dev/sdc {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c730169-ff03-4b6d-a991-1eef5da3c442]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4e378c-8259-490a-a65e-1778bfab6c8d]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] SCSI volumes sdc have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_245278c', '/dev/disk/by-id/scsi-23030656664653764', '/dev/disk/by-id/scsi-1SCST_BIO245278c-00efde7deaebef44') {{(pid=82243) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c39046-508e-45ab-890b-6d1f44e6e103]: (4, None) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bdfc4f-f257-460f-9958-a26d08bdbe94]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a98ed0d-cc04-42c1-a361-461b9196c705]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258, portal: 172.16.0.220,3260]
Apr 13 19:38:41 user nova-compute[71692]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258, portal: 172.16.0.220,3260] successful.
Apr 13 19:38:41 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06e23084-c70b-425b-bd8a-e524d1f48258 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed63239-bef5-47ac-8c73-c519f846df52]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] <== disconnect_volume: return (308ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:38:41 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Deleting instance files /opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76_del
Apr 13 19:38:41 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Deletion of /opt/stack/data/nova/instances/f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76_del complete
Apr 13 19:38:41 user nova-compute[71692]: INFO nova.compute.manager [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 13 19:38:41 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:38:41 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:38:42 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:38:42 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Took 0.46 seconds to deallocate network for instance.
Apr 13 19:38:42 user nova-compute[71692]: DEBUG nova.compute.manager [req-246372ac-b46a-4a52-84d8-b92d090285df req-d7d8ed1e-46c3-471b-acd0-5aa05ef22adc service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received event network-vif-deleted-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:38:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-353d202a-5b9f-4e08-8e07-89032ad93c4a req-ebe64378-238c-4717-81c5-34bead96624e service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:38:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-353d202a-5b9f-4e08-8e07-89032ad93c4a req-ebe64378-238c-4717-81c5-34bead96624e service nova] Acquiring lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:38:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-353d202a-5b9f-4e08-8e07-89032ad93c4a req-ebe64378-238c-4717-81c5-34bead96624e service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:38:43 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-353d202a-5b9f-4e08-8e07-89032ad93c4a req-ebe64378-238c-4717-81c5-34bead96624e service nova] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:38:43 user nova-compute[71692]: DEBUG nova.compute.manager [req-353d202a-5b9f-4e08-8e07-89032ad93c4a req-ebe64378-238c-4717-81c5-34bead96624e service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] No waiting events found dispatching network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:38:43 user nova-compute[71692]: WARNING nova.compute.manager [req-353d202a-5b9f-4e08-8e07-89032ad93c4a req-ebe64378-238c-4717-81c5-34bead96624e service nova] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Received unexpected event network-vif-plugged-7d634c23-9eff-4a07-8036-b5ddc748828e for instance with vm_state active and task_state deleting.
Apr 13 19:38:44 user nova-compute[71692]: INFO nova.compute.manager [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Took 1.77 seconds to detach 1 volumes for instance.
Apr 13 19:38:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:38:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:38:44 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:38:44 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:38:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:38:44 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Deleted allocations for instance f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76
Apr 13 19:38:44 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-30c13b9f-03f6-4923-abc4-7fac58c8dbc0 tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.748s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:38:46 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:51 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:55 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:56 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681414721.5323281, f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:38:56 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] VM Stopped (Lifecycle Event)
Apr 13 19:38:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ec17433b-98bf-47b9-9200-85a8bd334bdd None None] [instance: f4a5d4a8-4f4d-4f38-97fb-a9f6cd9d0b76] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:38:56 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:38:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:39:01 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:39:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:39:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:39:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:39:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:39:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:39:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:39:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:39:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:39:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:39:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:39:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:39:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:39:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:39:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:39:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:39:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:39:06 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:39:06 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:39:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8728MB free_disk=25.786876678466797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:39:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:39:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:39:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:39:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:39:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:39:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:39:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:39:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:39:06 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:39:06 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:39:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:39:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:39:07 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:39:07 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:39:07 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Didn't find any instances for network info cache update. {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 19:39:07 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:39:07 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:39:08 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:39:09 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:39:11 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:39:12 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:39:12 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:39:16 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:39:18 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:39:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:39:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:39:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:39:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:39:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:39:21 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:39:26 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:39:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:39:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:39:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:39:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:39:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:39:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:39:31 user nova-compute[71692]: INFO nova.compute.manager [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Terminating instance
Apr 13 19:39:31 user nova-compute[71692]: DEBUG nova.compute.manager [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:39:31 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:39:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-d4d931bc-fa9b-4e2b-ac0f-e94ab74a3832 req-dad1c536-c954-4a97-a828-cf1b98b8868b service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Received event network-vif-unplugged-89ac5520-b022-42dd-a10d-6621de9ecd5f {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:39:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d4d931bc-fa9b-4e2b-ac0f-e94ab74a3832 req-dad1c536-c954-4a97-a828-cf1b98b8868b service nova] Acquiring lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:39:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d4d931bc-fa9b-4e2b-ac0f-e94ab74a3832 req-dad1c536-c954-4a97-a828-cf1b98b8868b service nova] Lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:39:31 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-d4d931bc-fa9b-4e2b-ac0f-e94ab74a3832 req-dad1c536-c954-4a97-a828-cf1b98b8868b service nova] Lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:39:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-d4d931bc-fa9b-4e2b-ac0f-e94ab74a3832 req-dad1c536-c954-4a97-a828-cf1b98b8868b service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] No waiting events found dispatching network-vif-unplugged-89ac5520-b022-42dd-a10d-6621de9ecd5f {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:39:31 user nova-compute[71692]: DEBUG nova.compute.manager [req-d4d931bc-fa9b-4e2b-ac0f-e94ab74a3832 req-dad1c536-c954-4a97-a828-cf1b98b8868b service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Received event network-vif-unplugged-89ac5520-b022-42dd-a10d-6621de9ecd5f for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:39:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:39:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:39:32 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Instance destroyed successfully.
Apr 13 19:39:32 user nova-compute[71692]: DEBUG nova.objects.instance [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'resources' on Instance uuid fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:39:32 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1651036996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1651036996',id=41,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:30:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c00a7fcd6d3040e8b2db0448eeda93ad',ramdisk_id='',reservation_id='r-fo5x2kms',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:32:06Z,user_data=None,user_id='dd604fa4d17b42b1abea8c2f2405b58d',uuid=fd2fe4b2-e5ae-487f-bda2-6b3102204ad6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "address": "fa:16:3e:c5:4f:ac", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ac5520-b0", "ovs_interfaceid": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:39:32 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converting VIF {"id": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "address": "fa:16:3e:c5:4f:ac", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89ac5520-b0", "ovs_interfaceid": "89ac5520-b022-42dd-a10d-6621de9ecd5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:39:32 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:4f:ac,bridge_name='br-int',has_traffic_filtering=True,id=89ac5520-b022-42dd-a10d-6621de9ecd5f,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ac5520-b0') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:39:32 user nova-compute[71692]: DEBUG os_vif [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:4f:ac,bridge_name='br-int',has_traffic_filtering=True,id=89ac5520-b022-42dd-a10d-6621de9ecd5f,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ac5520-b0') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:39:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:39:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89ac5520-b0, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:39:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:39:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:39:32 user nova-compute[71692]: INFO os_vif [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:4f:ac,bridge_name='br-int',has_traffic_filtering=True,id=89ac5520-b022-42dd-a10d-6621de9ecd5f,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89ac5520-b0')
Apr 13 19:39:32 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Deleting instance files /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6_del
Apr 13 19:39:32 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Deletion of /opt/stack/data/nova/instances/fd2fe4b2-e5ae-487f-bda2-6b3102204ad6_del complete
Apr 13 19:39:32 user nova-compute[71692]: INFO nova.compute.manager [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Took 0.73 seconds to destroy the instance on the hypervisor.
Apr 13 19:39:32 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:39:32 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:39:32 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:39:33 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:39:33 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Took 0.94 seconds to deallocate network for instance.
Apr 13 19:39:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:39:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:39:33 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:39:33 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:39:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:39:33 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Deleted allocations for instance fd2fe4b2-e5ae-487f-bda2-6b3102204ad6
Apr 13 19:39:33 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-0e1df8ab-0293-4e5f-a4ee-6157ee14d62a tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.027s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:39:34 user nova-compute[71692]: DEBUG nova.compute.manager [req-21b8709d-a5ce-4d1a-b583-8ba2d80ef3b6 req-cdcb0dc4-7c9d-419a-bd3c-5dbc1fbe6c4c service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Received event network-vif-plugged-89ac5520-b022-42dd-a10d-6621de9ecd5f {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:39:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-21b8709d-a5ce-4d1a-b583-8ba2d80ef3b6 req-cdcb0dc4-7c9d-419a-bd3c-5dbc1fbe6c4c service nova] Acquiring lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:39:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-21b8709d-a5ce-4d1a-b583-8ba2d80ef3b6 req-cdcb0dc4-7c9d-419a-bd3c-5dbc1fbe6c4c service nova] Lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:39:34 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-21b8709d-a5ce-4d1a-b583-8ba2d80ef3b6 req-cdcb0dc4-7c9d-419a-bd3c-5dbc1fbe6c4c service nova] Lock "fd2fe4b2-e5ae-487f-bda2-6b3102204ad6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:39:34 user nova-compute[71692]: DEBUG nova.compute.manager [req-21b8709d-a5ce-4d1a-b583-8ba2d80ef3b6 req-cdcb0dc4-7c9d-419a-bd3c-5dbc1fbe6c4c service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] No waiting events found dispatching network-vif-plugged-89ac5520-b022-42dd-a10d-6621de9ecd5f {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:39:34 user nova-compute[71692]: WARNING nova.compute.manager [req-21b8709d-a5ce-4d1a-b583-8ba2d80ef3b6 req-cdcb0dc4-7c9d-419a-bd3c-5dbc1fbe6c4c service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Received unexpected event network-vif-plugged-89ac5520-b022-42dd-a10d-6621de9ecd5f for instance with vm_state deleted and task_state None.
Apr 13 19:39:34 user nova-compute[71692]: DEBUG nova.compute.manager [req-21b8709d-a5ce-4d1a-b583-8ba2d80ef3b6 req-cdcb0dc4-7c9d-419a-bd3c-5dbc1fbe6c4c service nova] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Received event network-vif-deleted-89ac5520-b022-42dd-a10d-6621de9ecd5f {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:39:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:39:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:39:47 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681414772.2241893, fd2fe4b2-e5ae-487f-bda2-6b3102204ad6 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:39:47 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] VM Stopped (Lifecycle Event)
Apr 13 19:39:47 user nova-compute[71692]: DEBUG nova.compute.manager [None req-525bb238-9144-4c9d-98e0-6169187f2c08 None None] [instance: fd2fe4b2-e5ae-487f-bda2-6b3102204ad6] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:39:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:39:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:39:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:39:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:39:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:39:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:39:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:39:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:39:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:40:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:40:03 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:40:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:40:05 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:40:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:40:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:40:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:40:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:40:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:40:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:40:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:40:05 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:40:05 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71692) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 19:40:05 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:40:05 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:40:05 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8802MB free_disk=25.87774658203125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:40:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:40:05 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:40:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:40:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:40:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:40:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:40:06 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:40:06 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:40:06 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:40:06 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:40:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:40:09 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:40:09 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:40:09 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 19:40:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:40:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:40:09 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:40:09 user nova-compute[71692]: DEBUG nova.objects.instance [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lazy-loading 'info_cache' on Instance uuid 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:40:09 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updating instance_info_cache with network_info: [{"id": "5bd81344-f669-49c6-897f-97510d86e77b", "address": "fa:16:3e:01:0c:f9", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd81344-f6", "ovs_interfaceid": "5bd81344-f669-49c6-897f-97510d86e77b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:40:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:40:09 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:40:09 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:40:09 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:40:11 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:40:12 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:40:12 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:40:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:40:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:40:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:40:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:40:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:40:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:40:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:40:18 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:40:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:40:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:40:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:40:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:40:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:40:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:40:22 user nova-compute[71692]: INFO nova.compute.manager [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Terminating instance
Apr 13 19:40:22 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:40:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:40:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:40:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-acce0339-751b-454b-9230-14b4c1ae82b6 req-b39f1f56-3181-449c-9ee7-02b2f298eff8 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received event network-vif-unplugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:40:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-acce0339-751b-454b-9230-14b4c1ae82b6 req-b39f1f56-3181-449c-9ee7-02b2f298eff8 service nova] Acquiring lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:40:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-acce0339-751b-454b-9230-14b4c1ae82b6 req-b39f1f56-3181-449c-9ee7-02b2f298eff8 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:40:22 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-acce0339-751b-454b-9230-14b4c1ae82b6 req-b39f1f56-3181-449c-9ee7-02b2f298eff8 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:40:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-acce0339-751b-454b-9230-14b4c1ae82b6 req-b39f1f56-3181-449c-9ee7-02b2f298eff8 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] No waiting events found dispatching network-vif-unplugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:40:22 user nova-compute[71692]: DEBUG nova.compute.manager [req-acce0339-751b-454b-9230-14b4c1ae82b6 req-b39f1f56-3181-449c-9ee7-02b2f298eff8 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received event network-vif-unplugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:40:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:40:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:40:23 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Instance destroyed successfully.
Apr 13 19:40:23 user nova-compute[71692]: DEBUG nova.objects.instance [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'resources' on Instance uuid 991871a0-3a4e-4014-b07f-3e8c49eeda5a {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:24:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-984612808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-984612808',id=37,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:26:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c00a7fcd6d3040e8b2db0448eeda93ad',ramdisk_id='',reservation_id='r-tflw5ozm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:28:24Z,user_data=None,user_id='dd604fa4d17b42b1abea8c2f2405b58d',uuid=991871a0-3a4e-4014-b07f-3e8c49eeda5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converting VIF {"id": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "address": "fa:16:3e:c8:17:3b", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap405a3575-62", "ovs_interfaceid": "405a3575-62ce-4c5c-8090-40f2fabf7d61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:17:3b,bridge_name='br-int',has_traffic_filtering=True,id=405a3575-62ce-4c5c-8090-40f2fabf7d61,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405a3575-62') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_vif [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:17:3b,bridge_name='br-int',has_traffic_filtering=True,id=405a3575-62ce-4c5c-8090-40f2fabf7d61,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405a3575-62') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap405a3575-62, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:40:23 user nova-compute[71692]: INFO os_vif [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:17:3b,bridge_name='br-int',has_traffic_filtering=True,id=405a3575-62ce-4c5c-8090-40f2fabf7d61,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap405a3575-62')
Apr 13 19:40:23 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] calling os-brick to detach iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7febcc3c8850>, {'target_iqn': 'iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PLywANqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 19:40:23 user nova-compute[71692]: WARNING os_brick.initiator.connectors.base [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fe185d-5d3b-421c-9832-cb3a89f37abb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 19:40:23 user nova-compute[71692]: No targets found.
Apr 13 19:40:23 user nova-compute[71692]: iSNS:
Apr 13 19:40:23 user nova-compute[71692]: No targets found.
Apr 13 19:40:23 user nova-compute[71692]: STATIC:
Apr 13 19:40:23 user nova-compute[71692]: Target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945
Apr 13 19:40:23 user nova-compute[71692]:         Portal: 172.16.0.220:3260,-1
Apr 13 19:40:23 user nova-compute[71692]:                 Iface Name: default
Apr 13 19:40:23 user nova-compute[71692]: FIRMWARE:
Apr 13 19:40:23 user nova-compute[71692]: No targets found.
Apr 13 19:40:23 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 19:40:23 user nova-compute[71692]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 19:40:23 user nova-compute[71692]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71692) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945', 0)] {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[42020da5-a930-4983-93c9-bb5000e1bbe0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[03893a4a-bf28-4f57-b669-33dbc75f5f96]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:40:23 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 (non-flash)
Apr 13 19:40:23 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7feba055d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945'): ({'sdb'}, set())}) {{(pid=71692) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Removing single pathed devices sdb {{(pid=71692) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ee5a67-cff1-4bf4-9d40-5424d2fd4cdc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f31a1ad-1ddb-4b19-83c8-f880afe69003]: (4, ('ok\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Flushing IO for device /dev/sdb {{(pid=71692) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e726280-e7ba-44a6-ac47-44b443395ae1]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71692) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae12bc17-b64b-4fe0-ad8b-5fd98f066117]: (4, ('1', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.linuxscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] SCSI volumes sdb have been removed. {{(pid=71692) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945')] {{(pid=71692) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0a244a-6ad8-4e9c-a827-8261a24f2784]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --logout {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db5fb32-74b9-4a6f-bac2-7336ae213045]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945, portal: 172.16.0.220,3260]
Apr 13 19:40:23 user nova-compute[71692]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945, portal: 172.16.0.220,3260] successful.
Apr 13 19:40:23 user nova-compute[71692]:  stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op delete {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:313c34d8-f051-4710-8baf-f34af4471945 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82243) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f5b1ab-cb65-470c-baad-86adf76cdeb0]: (4, ('', '')) {{(pid=82243) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71692) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.base [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG os_brick.initiator.connectors.iscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] <== disconnect_volume: return (290ms) None {{(pid=71692) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Disconnected iSCSI Volume {{(pid=71692) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 19:40:23 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Deleting instance files /opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a_del
Apr 13 19:40:23 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Deletion of /opt/stack/data/nova/instances/991871a0-3a4e-4014-b07f-3e8c49eeda5a_del complete
Apr 13 19:40:23 user nova-compute[71692]: INFO nova.compute.manager [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Took 1.14 seconds to destroy the instance on the hypervisor.
Apr 13 19:40:23 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:40:23 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:40:24 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:40:24 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Took 0.44 seconds to deallocate network for instance.
Apr 13 19:40:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-1d653527-9af8-4f10-88b4-db392b6560ba req-dbd48dea-8aa1-424c-9cb9-888c4717d6f7 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received event network-vif-deleted-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:40:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-299f7536-54d0-4fa4-b638-d97892f50763 req-91539a9d-6acc-450a-85b1-5d5766dfd9d8 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:40:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-299f7536-54d0-4fa4-b638-d97892f50763 req-91539a9d-6acc-450a-85b1-5d5766dfd9d8 service nova] Acquiring lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:40:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-299f7536-54d0-4fa4-b638-d97892f50763 req-91539a9d-6acc-450a-85b1-5d5766dfd9d8 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:40:24 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-299f7536-54d0-4fa4-b638-d97892f50763 req-91539a9d-6acc-450a-85b1-5d5766dfd9d8 service nova] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:40:24 user nova-compute[71692]: DEBUG nova.compute.manager [req-299f7536-54d0-4fa4-b638-d97892f50763 req-91539a9d-6acc-450a-85b1-5d5766dfd9d8 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] No waiting events found dispatching network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:40:24 user nova-compute[71692]: WARNING nova.compute.manager [req-299f7536-54d0-4fa4-b638-d97892f50763 req-91539a9d-6acc-450a-85b1-5d5766dfd9d8 service nova] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Received unexpected event network-vif-plugged-405a3575-62ce-4c5c-8090-40f2fabf7d61 for instance with vm_state active and task_state deleting.
Apr 13 19:40:25 user nova-compute[71692]: INFO nova.compute.manager [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Took 0.98 seconds to detach 1 volumes for instance.
Apr 13 19:40:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:40:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:40:25 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:40:25 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:40:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:40:25 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Deleted allocations for instance 991871a0-3a4e-4014-b07f-3e8c49eeda5a
Apr 13 19:40:25 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f796d653-4c1e-4931-aea4-f90c182952ee tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "991871a0-3a4e-4014-b07f-3e8c49eeda5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.854s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:40:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:40:33 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:40:38 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681414823.3199878, 991871a0-3a4e-4014-b07f-3e8c49eeda5a => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:40:38 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] VM Stopped (Lifecycle Event)
Apr 13 19:40:38 user nova-compute[71692]: DEBUG nova.compute.manager [None req-ee2bc50c-7ad1-4980-90cc-0181fe69c776 None None] [instance: 991871a0-3a4e-4014-b07f-3e8c49eeda5a] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:40:38 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:40:43 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:40:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:40:53 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:40:58 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:41:03 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:41:03 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:41:07 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:41:07 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:41:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:41:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:41:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:41:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:41:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:41:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:41:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:41:07 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:41:07 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:41:07 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:41:07 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=25.876922607421875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:41:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:41:07 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:41:08 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:41:08 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:41:08 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:41:08 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:41:08 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:41:08 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:41:08 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:41:08 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:41:11 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:41:11 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:41:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:41:11 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Didn't find any instances for network info cache update. {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 19:41:11 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:41:11 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:41:12 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:41:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:41:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:41:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:41:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:41:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:41:13 user nova-compute[71692]: INFO nova.compute.manager [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Terminating instance
Apr 13 19:41:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:41:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:41:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:41:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:41:13 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:41:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-745ca4c4-49a1-43ac-aaa0-21497c03eb2d req-28e891e8-0bc4-42d8-baa0-5e7696fdf812 service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Received event network-vif-unplugged-5bd81344-f669-49c6-897f-97510d86e77b {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:41:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-745ca4c4-49a1-43ac-aaa0-21497c03eb2d req-28e891e8-0bc4-42d8-baa0-5e7696fdf812 service nova] Acquiring lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:41:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-745ca4c4-49a1-43ac-aaa0-21497c03eb2d req-28e891e8-0bc4-42d8-baa0-5e7696fdf812 service nova] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:41:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-745ca4c4-49a1-43ac-aaa0-21497c03eb2d req-28e891e8-0bc4-42d8-baa0-5e7696fdf812 service nova] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:41:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-745ca4c4-49a1-43ac-aaa0-21497c03eb2d req-28e891e8-0bc4-42d8-baa0-5e7696fdf812 service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] No waiting events found dispatching network-vif-unplugged-5bd81344-f669-49c6-897f-97510d86e77b {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:41:13 user nova-compute[71692]: DEBUG nova.compute.manager [req-745ca4c4-49a1-43ac-aaa0-21497c03eb2d req-28e891e8-0bc4-42d8-baa0-5e7696fdf812 service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Received event network-vif-unplugged-5bd81344-f669-49c6-897f-97510d86e77b for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:41:14 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Instance destroyed successfully.
Apr 13 19:41:14 user nova-compute[71692]: DEBUG nova.objects.instance [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lazy-loading 'resources' on Instance uuid 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:41:14 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:21:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1490322609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1490322609',id=35,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:21:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c00a7fcd6d3040e8b2db0448eeda93ad',ramdisk_id='',reservation_id='r-ke3m9ivx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:23:35Z,user_data=None,user_id='dd604fa4d17b42b1abea8c2f2405b58d',uuid=2d0186ca-d0ab-46f3-b9b5-6461e8ceef96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bd81344-f669-49c6-897f-97510d86e77b", "address": "fa:16:3e:01:0c:f9", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd81344-f6", "ovs_interfaceid": "5bd81344-f669-49c6-897f-97510d86e77b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:41:14 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converting VIF {"id": "5bd81344-f669-49c6-897f-97510d86e77b", "address": "fa:16:3e:01:0c:f9", "network": {"id": "09341996-8218-4461-9635-d3f9187c1d42", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-547947202-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c00a7fcd6d3040e8b2db0448eeda93ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd81344-f6", "ovs_interfaceid": "5bd81344-f669-49c6-897f-97510d86e77b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:41:14 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:0c:f9,bridge_name='br-int',has_traffic_filtering=True,id=5bd81344-f669-49c6-897f-97510d86e77b,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd81344-f6') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:41:14 user nova-compute[71692]: DEBUG os_vif [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:0c:f9,bridge_name='br-int',has_traffic_filtering=True,id=5bd81344-f669-49c6-897f-97510d86e77b,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd81344-f6') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:41:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:41:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bd81344-f6, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:41:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:41:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:41:14 user nova-compute[71692]: INFO os_vif [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:0c:f9,bridge_name='br-int',has_traffic_filtering=True,id=5bd81344-f669-49c6-897f-97510d86e77b,network=Network(09341996-8218-4461-9635-d3f9187c1d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd81344-f6')
Apr 13 19:41:14 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Deleting instance files /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96_del
Apr 13 19:41:14 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Deletion of /opt/stack/data/nova/instances/2d0186ca-d0ab-46f3-b9b5-6461e8ceef96_del complete
Apr 13 19:41:14 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:41:14 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:41:14 user nova-compute[71692]: INFO nova.compute.manager [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 13 19:41:14 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:41:14 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:41:14 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:41:14 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:41:14 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Took 0.45 seconds to deallocate network for instance.
Apr 13 19:41:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:41:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:41:14 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:41:14 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:41:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:41:14 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Deleted allocations for instance 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96
Apr 13 19:41:14 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-1398e0a9-cc96-4e95-a066-8f52a1cf98bf tempest-ServerBootFromVolumeStableRescueTest-1051313256 tempest-ServerBootFromVolumeStableRescueTest-1051313256-project-member] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.629s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:41:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-3f827c33-67b9-45d7-8aff-6596efcb33f1 req-ce6e11ec-4a4e-443c-ba16-ffbd989f030e service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Received event network-vif-plugged-5bd81344-f669-49c6-897f-97510d86e77b {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:41:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f827c33-67b9-45d7-8aff-6596efcb33f1 req-ce6e11ec-4a4e-443c-ba16-ffbd989f030e service nova] Acquiring lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:41:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f827c33-67b9-45d7-8aff-6596efcb33f1 req-ce6e11ec-4a4e-443c-ba16-ffbd989f030e service nova] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:41:15 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-3f827c33-67b9-45d7-8aff-6596efcb33f1 req-ce6e11ec-4a4e-443c-ba16-ffbd989f030e service nova] Lock "2d0186ca-d0ab-46f3-b9b5-6461e8ceef96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:41:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-3f827c33-67b9-45d7-8aff-6596efcb33f1 req-ce6e11ec-4a4e-443c-ba16-ffbd989f030e service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] No waiting events found dispatching network-vif-plugged-5bd81344-f669-49c6-897f-97510d86e77b {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:41:15 user nova-compute[71692]: WARNING nova.compute.manager [req-3f827c33-67b9-45d7-8aff-6596efcb33f1 req-ce6e11ec-4a4e-443c-ba16-ffbd989f030e service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Received unexpected event network-vif-plugged-5bd81344-f669-49c6-897f-97510d86e77b for instance with vm_state deleted and task_state None.
Apr 13 19:41:15 user nova-compute[71692]: DEBUG nova.compute.manager [req-3f827c33-67b9-45d7-8aff-6596efcb33f1 req-ce6e11ec-4a4e-443c-ba16-ffbd989f030e service nova] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Received event network-vif-deleted-5bd81344-f669-49c6-897f-97510d86e77b {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:41:18 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:41:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:41:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:41:29 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681414874.0757558, 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96 => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:41:29 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] VM Stopped (Lifecycle Event)
Apr 13 19:41:29 user nova-compute[71692]: DEBUG nova.compute.manager [None req-183f23d1-ae7b-47f7-b476-ef005dfc6282 None None] [instance: 2d0186ca-d0ab-46f3-b9b5-6461e8ceef96] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:41:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:41:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:41:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:41:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:41:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:41:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:41:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:41:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:41:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:41:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:41:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:41:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:41:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:41:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:41:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:41:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:41:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:04 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:42:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:06 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:08 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:42:09 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:42:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:42:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:42:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:42:09 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:42:09 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:42:09 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:42:09 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8924MB free_disk=25.967506408691406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:42:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:42:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:42:09 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:42:09 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:42:09 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:42:09 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:42:09 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:42:09 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:42:10 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:42:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:42:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 19:42:10 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Didn't find any instances for network info cache update. {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 19:42:10 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:42:10 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:42:13 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:42:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:42:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:42:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:42:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:42:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:15 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:42:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:42:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:20 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:42:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:42:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:42:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:42:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:42:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:42:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:42:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:42:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:42:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:42:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:42:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:42:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:42:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:42:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:42:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "7d939b5e-fb83-47fd-93ff-b77618bd803f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:42:56 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "7d939b5e-fb83-47fd-93ff-b77618bd803f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:42:56 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Starting instance... {{(pid=71692) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71692) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 19:42:57 user nova-compute[71692]: INFO nova.compute.claims [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Claim successful on node user
Apr 13 19:42:57 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.196s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Start building networks asynchronously for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Allocating IP information in the background. {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] allocate_for_instance() {{(pid=71692) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 19:42:57 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 19:42:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Start building block device mappings for instance. {{(pid=71692) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG nova.policy [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cc805b367d6459f92d36f349737dc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee076581e18f48349a20be41e4634b72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71692) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Start spawning the instance on the hypervisor. {{(pid=71692) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Creating instance directory {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 19:42:57 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Creating image(s)
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "/opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "/opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.131s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk 1073741824 {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31,backing_fmt=raw /opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk 1073741824" returned: 0 in 0.051s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb1da3db1a7a76f20ceeba55bc6e0e43036a5b31 --force-share --output=json" returned: 0 in 0.133s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk. size=1073741824 {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 19:42:57 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:42:58 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:42:58 user nova-compute[71692]: DEBUG nova.virt.disk.api [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Cannot resize image /opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk to a smaller size. {{(pid=71692) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 19:42:58 user nova-compute[71692]: DEBUG nova.objects.instance [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lazy-loading 'migration_context' on Instance uuid 7d939b5e-fb83-47fd-93ff-b77618bd803f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:42:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Created local disks {{(pid=71692) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 19:42:58 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Ensure instance console log exists: /opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/console.log {{(pid=71692) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 19:42:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:42:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:42:58 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:42:58 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Successfully created port: 2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 {{(pid=71692) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Successfully updated port: 2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 {{(pid=71692) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "refresh_cache-7d939b5e-fb83-47fd-93ff-b77618bd803f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquired lock "refresh_cache-7d939b5e-fb83-47fd-93ff-b77618bd803f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Building network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-775f5a80-bf85-4403-bf39-ee88593e509f req-6f32b495-075a-4475-92cf-4700ffd7de2a service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Received event network-changed-2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.compute.manager [req-775f5a80-bf85-4403-bf39-ee88593e509f req-6f32b495-075a-4475-92cf-4700ffd7de2a service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Refreshing instance network info cache due to event network-changed-2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46. {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-775f5a80-bf85-4403-bf39-ee88593e509f req-6f32b495-075a-4475-92cf-4700ffd7de2a service nova] Acquiring lock "refresh_cache-7d939b5e-fb83-47fd-93ff-b77618bd803f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Instance cache missing network info. {{(pid=71692) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.network.neutron [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Updating instance_info_cache with network_info: [{"id": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "address": "fa:16:3e:a6:b7:a7", "network": {"id": "976efd77-35c0-4c51-b757-73c7706b082a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f4eeb05bf5be437ea14fbf6a38f497cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3f8ab5-d7", "ovs_interfaceid": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Releasing lock "refresh_cache-7d939b5e-fb83-47fd-93ff-b77618bd803f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Instance network_info: |[{"id": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "address": "fa:16:3e:a6:b7:a7", "network": {"id": "976efd77-35c0-4c51-b757-73c7706b082a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f4eeb05bf5be437ea14fbf6a38f497cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3f8ab5-d7", "ovs_interfaceid": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71692) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-775f5a80-bf85-4403-bf39-ee88593e509f req-6f32b495-075a-4475-92cf-4700ffd7de2a service nova] Acquired lock "refresh_cache-7d939b5e-fb83-47fd-93ff-b77618bd803f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.network.neutron [req-775f5a80-bf85-4403-bf39-ee88593e509f req-6f32b495-075a-4475-92cf-4700ffd7de2a service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Refreshing network info cache for port 2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Start _get_guest_xml network_info=[{"id": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "address": "fa:16:3e:a6:b7:a7", "network": {"id": "976efd77-35c0-4c51-b757-73c7706b082a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f4eeb05bf5be437ea14fbf6a38f497cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3f8ab5-d7", "ovs_interfaceid": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encrypted': False, 'guest_format': None, 'image_id': 'e5467a4f-b219-48a2-9412-0a7e7ac851c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 19:42:59 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:42:59 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71692) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T18:53:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T18:52:53Z,direct_url=<?>,disk_format='qcow2',id=e5467a4f-b219-48a2-9412-0a7e7ac851c3,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f4eeb05bf5be437ea14fbf6a38f497cb',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T18:52:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Flavor limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Image limits 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Flavor pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Image pref 0:0:0 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Got 1 possible topologies {{(pid=71692) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.hardware [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71692) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1326800621',display_name='tempest-VolumesNegativeTest-instance-1326800621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1326800621',id=47,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee076581e18f48349a20be41e4634b72',ramdisk_id='',reservation_id='r-l68gz8rn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1091777559',owner_user_name='tempest-VolumesNegativeTest-1091777559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:42:57Z,user_data=None,user_id='7cc805b367d6459f92d36f349737dc75',uuid=7d939b5e-fb83-47fd-93ff-b77618bd803f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "address": "fa:16:3e:a6:b7:a7", "network": {"id": "976efd77-35c0-4c51-b757-73c7706b082a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f4eeb05bf5be437ea14fbf6a38f497cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3f8ab5-d7", "ovs_interfaceid": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71692) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Converting VIF {"id": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "address": "fa:16:3e:a6:b7:a7", "network": {"id": "976efd77-35c0-4c51-b757-73c7706b082a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f4eeb05bf5be437ea14fbf6a38f497cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3f8ab5-d7", "ovs_interfaceid": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b7:a7,bridge_name='br-int',has_traffic_filtering=True,id=2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46,network=Network(976efd77-35c0-4c51-b757-73c7706b082a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3f8ab5-d7') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.objects.instance [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d939b5e-fb83-47fd-93ff-b77618bd803f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 19:42:59 user nova-compute[71692]:   <uuid>7d939b5e-fb83-47fd-93ff-b77618bd803f</uuid>
Apr 13 19:42:59 user nova-compute[71692]:   <name>instance-0000002f</name>
Apr 13 19:42:59 user nova-compute[71692]:   <memory>131072</memory>
Apr 13 19:42:59 user nova-compute[71692]:   <vcpu>1</vcpu>
Apr 13 19:42:59 user nova-compute[71692]:   <metadata>
Apr 13 19:42:59 user nova-compute[71692]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 19:42:59 user nova-compute[71692]:       <nova:package version="0.0.0"/>
Apr 13 19:42:59 user nova-compute[71692]:       <nova:name>tempest-VolumesNegativeTest-instance-1326800621</nova:name>
Apr 13 19:42:59 user nova-compute[71692]:       <nova:creationTime>2023-04-13 19:42:59</nova:creationTime>
Apr 13 19:42:59 user nova-compute[71692]:       <nova:flavor name="m1.nano">
Apr 13 19:42:59 user nova-compute[71692]:         <nova:memory>128</nova:memory>
Apr 13 19:42:59 user nova-compute[71692]:         <nova:disk>1</nova:disk>
Apr 13 19:42:59 user nova-compute[71692]:         <nova:swap>0</nova:swap>
Apr 13 19:42:59 user nova-compute[71692]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 19:42:59 user nova-compute[71692]:         <nova:vcpus>1</nova:vcpus>
Apr 13 19:42:59 user nova-compute[71692]:       </nova:flavor>
Apr 13 19:42:59 user nova-compute[71692]:       <nova:owner>
Apr 13 19:42:59 user nova-compute[71692]:         <nova:user uuid="7cc805b367d6459f92d36f349737dc75">tempest-VolumesNegativeTest-1091777559-project-member</nova:user>
Apr 13 19:42:59 user nova-compute[71692]:         <nova:project uuid="ee076581e18f48349a20be41e4634b72">tempest-VolumesNegativeTest-1091777559</nova:project>
Apr 13 19:42:59 user nova-compute[71692]:       </nova:owner>
Apr 13 19:42:59 user nova-compute[71692]:       <nova:root type="image" uuid="e5467a4f-b219-48a2-9412-0a7e7ac851c3"/>
Apr 13 19:42:59 user nova-compute[71692]:       <nova:ports>
Apr 13 19:42:59 user nova-compute[71692]:         <nova:port uuid="2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46">
Apr 13 19:42:59 user nova-compute[71692]:           <nova:ip type="fixed" address="192.168.233.220" ipVersion="4"/>
Apr 13 19:42:59 user nova-compute[71692]:         </nova:port>
Apr 13 19:42:59 user nova-compute[71692]:       </nova:ports>
Apr 13 19:42:59 user nova-compute[71692]:     </nova:instance>
Apr 13 19:42:59 user nova-compute[71692]:   </metadata>
Apr 13 19:42:59 user nova-compute[71692]:   <sysinfo type="smbios">
Apr 13 19:42:59 user nova-compute[71692]:     <system>
Apr 13 19:42:59 user nova-compute[71692]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 19:42:59 user nova-compute[71692]:       <entry name="product">OpenStack Nova</entry>
Apr 13 19:42:59 user nova-compute[71692]:       <entry name="version">0.0.0</entry>
Apr 13 19:42:59 user nova-compute[71692]:       <entry name="serial">7d939b5e-fb83-47fd-93ff-b77618bd803f</entry>
Apr 13 19:42:59 user nova-compute[71692]:       <entry name="uuid">7d939b5e-fb83-47fd-93ff-b77618bd803f</entry>
Apr 13 19:42:59 user nova-compute[71692]:       <entry name="family">Virtual Machine</entry>
Apr 13 19:42:59 user nova-compute[71692]:     </system>
Apr 13 19:42:59 user nova-compute[71692]:   </sysinfo>
Apr 13 19:42:59 user nova-compute[71692]:   <os>
Apr 13 19:42:59 user nova-compute[71692]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 19:42:59 user nova-compute[71692]:     <boot dev="hd"/>
Apr 13 19:42:59 user nova-compute[71692]:     <smbios mode="sysinfo"/>
Apr 13 19:42:59 user nova-compute[71692]:   </os>
Apr 13 19:42:59 user nova-compute[71692]:   <features>
Apr 13 19:42:59 user nova-compute[71692]:     <acpi/>
Apr 13 19:42:59 user nova-compute[71692]:     <apic/>
Apr 13 19:42:59 user nova-compute[71692]:     <vmcoreinfo/>
Apr 13 19:42:59 user nova-compute[71692]:   </features>
Apr 13 19:42:59 user nova-compute[71692]:   <clock offset="utc">
Apr 13 19:42:59 user nova-compute[71692]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 19:42:59 user nova-compute[71692]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 19:42:59 user nova-compute[71692]:     <timer name="hpet" present="no"/>
Apr 13 19:42:59 user nova-compute[71692]:   </clock>
Apr 13 19:42:59 user nova-compute[71692]:   <cpu mode="custom" match="exact">
Apr 13 19:42:59 user nova-compute[71692]:     <model>Nehalem</model>
Apr 13 19:42:59 user nova-compute[71692]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 19:42:59 user nova-compute[71692]:   </cpu>
Apr 13 19:42:59 user nova-compute[71692]:   <devices>
Apr 13 19:42:59 user nova-compute[71692]:     <disk type="file" device="disk">
Apr 13 19:42:59 user nova-compute[71692]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 19:42:59 user nova-compute[71692]:       <source file="/opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk"/>
Apr 13 19:42:59 user nova-compute[71692]:       <target dev="vda" bus="virtio"/>
Apr 13 19:42:59 user nova-compute[71692]:     </disk>
Apr 13 19:42:59 user nova-compute[71692]:     <interface type="ethernet">
Apr 13 19:42:59 user nova-compute[71692]:       <mac address="fa:16:3e:a6:b7:a7"/>
Apr 13 19:42:59 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:42:59 user nova-compute[71692]:       <mtu size="1442"/>
Apr 13 19:42:59 user nova-compute[71692]:       <target dev="tap2a3f8ab5-d7"/>
Apr 13 19:42:59 user nova-compute[71692]:     </interface>
Apr 13 19:42:59 user nova-compute[71692]:     <serial type="pty">
Apr 13 19:42:59 user nova-compute[71692]:       <log file="/opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/console.log" append="off"/>
Apr 13 19:42:59 user nova-compute[71692]:     </serial>
Apr 13 19:42:59 user nova-compute[71692]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 19:42:59 user nova-compute[71692]:     <video>
Apr 13 19:42:59 user nova-compute[71692]:       <model type="virtio"/>
Apr 13 19:42:59 user nova-compute[71692]:     </video>
Apr 13 19:42:59 user nova-compute[71692]:     <rng model="virtio">
Apr 13 19:42:59 user nova-compute[71692]:       <backend model="random">/dev/urandom</backend>
Apr 13 19:42:59 user nova-compute[71692]:     </rng>
Apr 13 19:42:59 user nova-compute[71692]:     <controller type="usb" index="0" model="none"/>
Apr 13 19:42:59 user nova-compute[71692]:     <memballoon model="virtio">
Apr 13 19:42:59 user nova-compute[71692]:       <stats period="10"/>
Apr 13 19:42:59 user nova-compute[71692]:     </memballoon>
Apr 13 19:42:59 user nova-compute[71692]:   </devices>
Apr 13 19:42:59 user nova-compute[71692]: </domain>
Apr 13 19:42:59 user nova-compute[71692]:  {{(pid=71692) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1326800621',display_name='tempest-VolumesNegativeTest-instance-1326800621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1326800621',id=47,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee076581e18f48349a20be41e4634b72',ramdisk_id='',reservation_id='r-l68gz8rn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1091777559',owner_user_name='tempest-VolumesNegativeTest-1091777559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T19:42:57Z,user_data=None,user_id='7cc805b367d6459f92d36f349737dc75',uuid=7d939b5e-fb83-47fd-93ff-b77618bd803f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "address": "fa:16:3e:a6:b7:a7", "network": {"id": "976efd77-35c0-4c51-b757-73c7706b082a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f4eeb05bf5be437ea14fbf6a38f497cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3f8ab5-d7", "ovs_interfaceid": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Converting VIF {"id": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "address": "fa:16:3e:a6:b7:a7", "network": {"id": "976efd77-35c0-4c51-b757-73c7706b082a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f4eeb05bf5be437ea14fbf6a38f497cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3f8ab5-d7", "ovs_interfaceid": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b7:a7,bridge_name='br-int',has_traffic_filtering=True,id=2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46,network=Network(976efd77-35c0-4c51-b757-73c7706b082a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3f8ab5-d7') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG os_vif [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b7:a7,bridge_name='br-int',has_traffic_filtering=True,id=2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46,network=Network(976efd77-35c0-4c51-b757-73c7706b082a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3f8ab5-d7') {{(pid=71692) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a3f8ab5-d7, may_exist=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a3f8ab5-d7, col_values=(('external_ids', {'iface-id': '2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:b7:a7', 'vm-uuid': '7d939b5e-fb83-47fd-93ff-b77618bd803f'}),)) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:42:59 user nova-compute[71692]: INFO os_vif [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:b7:a7,bridge_name='br-int',has_traffic_filtering=True,id=2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46,network=Network(976efd77-35c0-4c51-b757-73c7706b082a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3f8ab5-d7')
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] No BDM found with device name vda, not building metadata. {{(pid=71692) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 19:42:59 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] No VIF found with MAC fa:16:3e:a6:b7:a7, not building metadata {{(pid=71692) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 19:43:00 user nova-compute[71692]: DEBUG nova.network.neutron [req-775f5a80-bf85-4403-bf39-ee88593e509f req-6f32b495-075a-4475-92cf-4700ffd7de2a service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Updated VIF entry in instance network info cache for port 2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46. {{(pid=71692) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 19:43:00 user nova-compute[71692]: DEBUG nova.network.neutron [req-775f5a80-bf85-4403-bf39-ee88593e509f req-6f32b495-075a-4475-92cf-4700ffd7de2a service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Updating instance_info_cache with network_info: [{"id": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "address": "fa:16:3e:a6:b7:a7", "network": {"id": "976efd77-35c0-4c51-b757-73c7706b082a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f4eeb05bf5be437ea14fbf6a38f497cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3f8ab5-d7", "ovs_interfaceid": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:43:00 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-775f5a80-bf85-4403-bf39-ee88593e509f req-6f32b495-075a-4475-92cf-4700ffd7de2a service nova] Releasing lock "refresh_cache-7d939b5e-fb83-47fd-93ff-b77618bd803f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:43:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-45afbc74-4786-4d7b-82ff-b1e6272d798c req-75b07195-4835-4163-b10c-e4f01751e989 service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Received event network-vif-plugged-2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:43:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-45afbc74-4786-4d7b-82ff-b1e6272d798c req-75b07195-4835-4163-b10c-e4f01751e989 service nova] Acquiring lock "7d939b5e-fb83-47fd-93ff-b77618bd803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:43:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-45afbc74-4786-4d7b-82ff-b1e6272d798c req-75b07195-4835-4163-b10c-e4f01751e989 service nova] Lock "7d939b5e-fb83-47fd-93ff-b77618bd803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:43:01 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-45afbc74-4786-4d7b-82ff-b1e6272d798c req-75b07195-4835-4163-b10c-e4f01751e989 service nova] Lock "7d939b5e-fb83-47fd-93ff-b77618bd803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:43:01 user nova-compute[71692]: DEBUG nova.compute.manager [req-45afbc74-4786-4d7b-82ff-b1e6272d798c req-75b07195-4835-4163-b10c-e4f01751e989 service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] No waiting events found dispatching network-vif-plugged-2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:43:01 user nova-compute[71692]: WARNING nova.compute.manager [req-45afbc74-4786-4d7b-82ff-b1e6272d798c req-75b07195-4835-4163-b10c-e4f01751e989 service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Received unexpected event network-vif-plugged-2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 for instance with vm_state building and task_state spawning.
Apr 13 19:43:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:01 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414983.2696953, 7d939b5e-fb83-47fd-93ff-b77618bd803f => Resumed> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:43:03 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] VM Resumed (Lifecycle Event)
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Instance event wait completed in 0 seconds for  {{(pid=71692) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Guest created on hypervisor {{(pid=71692) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 19:43:03 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Instance spawned successfully.
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Found default for hw_cdrom_bus of ide {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Found default for hw_disk_bus of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Found default for hw_input_bus of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Found default for hw_pointer_model of None {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Found default for hw_video_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.virt.libvirt.driver [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Found default for hw_vif_model of virtio {{(pid=71692) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 19:43:03 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.virt.driver [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] Emitting event <LifecycleEvent: 1681414983.2709193, 7d939b5e-fb83-47fd-93ff-b77618bd803f => Started> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:43:03 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] VM Started (Lifecycle Event)
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71692) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 19:43:03 user nova-compute[71692]: INFO nova.compute.manager [None req-a3a87f8b-3f1b-4d66-a395-406e0caa2250 None None] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 19:43:03 user nova-compute[71692]: INFO nova.compute.manager [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Took 5.90 seconds to spawn the instance on the hypervisor.
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.compute.manager [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:43:03 user nova-compute[71692]: INFO nova.compute.manager [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Took 6.39 seconds to build instance.
Apr 13 19:43:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-d2854993-b0e1-4c7b-aee4-1c7c826bb0c5 tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "7d939b5e-fb83-47fd-93ff-b77618bd803f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.485s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.compute.manager [req-915b6316-e4a2-413f-927d-242aef15ed36 req-bacf5c6e-84f2-4d35-ac45-a21d4857e2c2 service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Received event network-vif-plugged-2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:43:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-915b6316-e4a2-413f-927d-242aef15ed36 req-bacf5c6e-84f2-4d35-ac45-a21d4857e2c2 service nova] Acquiring lock "7d939b5e-fb83-47fd-93ff-b77618bd803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:43:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-915b6316-e4a2-413f-927d-242aef15ed36 req-bacf5c6e-84f2-4d35-ac45-a21d4857e2c2 service nova] Lock "7d939b5e-fb83-47fd-93ff-b77618bd803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:43:03 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-915b6316-e4a2-413f-927d-242aef15ed36 req-bacf5c6e-84f2-4d35-ac45-a21d4857e2c2 service nova] Lock "7d939b5e-fb83-47fd-93ff-b77618bd803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:43:03 user nova-compute[71692]: DEBUG nova.compute.manager [req-915b6316-e4a2-413f-927d-242aef15ed36 req-bacf5c6e-84f2-4d35-ac45-a21d4857e2c2 service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] No waiting events found dispatching network-vif-plugged-2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:43:03 user nova-compute[71692]: WARNING nova.compute.manager [req-915b6316-e4a2-413f-927d-242aef15ed36 req-bacf5c6e-84f2-4d35-ac45-a21d4857e2c2 service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Received unexpected event network-vif-plugged-2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 for instance with vm_state active and task_state None.
Apr 13 19:43:04 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:43:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:10 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:43:10 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:43:10 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:43:10 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:43:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:43:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:43:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:43:10 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:43:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:43:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:43:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:43:10 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:43:10 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:43:10 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:43:10 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8777MB free_disk=25.963970184326172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:43:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:43:10 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:43:11 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 7d939b5e-fb83-47fd-93ff-b77618bd803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:43:11 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:43:11 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:43:11 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing inventories for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 19:43:11 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating ProviderTree inventory for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 19:43:11 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Updating inventory in ProviderTree for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 19:43:11 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing aggregate associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, aggregates: None {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 19:43:11 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Refreshing trait associations for resource provider 6ec8625c-38f9-4b14-a833-1c01964497f1, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL {{(pid=71692) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 19:43:11 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:43:11 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:43:11 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:43:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:43:12 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:43:12 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:43:12 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 19:43:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-7d939b5e-fb83-47fd-93ff-b77618bd803f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:43:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-7d939b5e-fb83-47fd-93ff-b77618bd803f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:43:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:43:12 user nova-compute[71692]: DEBUG nova.objects.instance [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lazy-loading 'info_cache' on Instance uuid 7d939b5e-fb83-47fd-93ff-b77618bd803f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:43:12 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Updating instance_info_cache with network_info: [{"id": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "address": "fa:16:3e:a6:b7:a7", "network": {"id": "976efd77-35c0-4c51-b757-73c7706b082a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f4eeb05bf5be437ea14fbf6a38f497cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3f8ab5-d7", "ovs_interfaceid": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:43:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-7d939b5e-fb83-47fd-93ff-b77618bd803f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:43:12 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:43:12 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:43:13 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:43:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:43:15 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:43:15 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:43:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:21 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:43:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:23 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:43:23 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 19:43:23 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] There are 0 instances to clean {{(pid=71692) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 19:43:24 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:43:24 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71692) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 19:43:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:26 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:43:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:43:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:43:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:43:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:43:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:43:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:43:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:43:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:43:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:43:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:49 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:43:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:43:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:43:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:43:54 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:43:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:43:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:43:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:43:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:43:59 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:04 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:06 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:44:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:44:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:44:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:44:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:44:09 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:11 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:44:11 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:44:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:44:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:44:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:44:11 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:44:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:44:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:44:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk --force-share --output=json {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 19:44:11 user nova-compute[71692]: DEBUG oslo_concurrency.processutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71692) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 19:44:11 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:44:11 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:44:11 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8803MB free_disk=25.943748474121094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:44:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:44:11 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:44:11 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Instance 7d939b5e-fb83-47fd-93ff-b77618bd803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71692) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 19:44:11 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:44:11 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:44:12 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:44:12 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:44:12 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:44:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "refresh_cache-7d939b5e-fb83-47fd-93ff-b77618bd803f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquired lock "refresh_cache-7d939b5e-fb83-47fd-93ff-b77618bd803f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Forcefully refreshing network info cache for instance {{(pid=71692) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG nova.objects.instance [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lazy-loading 'info_cache' on Instance uuid 7d939b5e-fb83-47fd-93ff-b77618bd803f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG nova.network.neutron [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Updating instance_info_cache with network_info: [{"id": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "address": "fa:16:3e:a6:b7:a7", "network": {"id": "976efd77-35c0-4c51-b757-73c7706b082a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f4eeb05bf5be437ea14fbf6a38f497cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3f8ab5-d7", "ovs_interfaceid": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Releasing lock "refresh_cache-7d939b5e-fb83-47fd-93ff-b77618bd803f" {{(pid=71692) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Updated the network info_cache for instance {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Triggering sync for uuid 7d939b5e-fb83-47fd-93ff-b77618bd803f {{(pid=71692) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "7d939b5e-fb83-47fd-93ff-b77618bd803f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "7d939b5e-fb83-47fd-93ff-b77618bd803f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:44:13 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "7d939b5e-fb83-47fd-93ff-b77618bd803f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.022s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:44:14 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:17 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:44:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:44:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:44:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:44:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:44:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:44:19 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:23 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:44:24 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:44:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:44:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:44:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:44:29 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:34 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:44:39 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:44:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:44:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:44:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:44:44 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:44:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:44:45 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "7d939b5e-fb83-47fd-93ff-b77618bd803f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:44:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "7d939b5e-fb83-47fd-93ff-b77618bd803f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:44:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "7d939b5e-fb83-47fd-93ff-b77618bd803f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:44:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "7d939b5e-fb83-47fd-93ff-b77618bd803f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:44:46 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "7d939b5e-fb83-47fd-93ff-b77618bd803f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:44:46 user nova-compute[71692]: INFO nova.compute.manager [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Terminating instance
Apr 13 19:44:46 user nova-compute[71692]: DEBUG nova.compute.manager [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Start destroying the instance on the hypervisor. {{(pid=71692) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-02191640-898b-490e-bbd0-bab72d047f03 req-3e32dfab-b12d-48c4-a4af-01298489b6ed service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Received event network-vif-unplugged-2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-02191640-898b-490e-bbd0-bab72d047f03 req-3e32dfab-b12d-48c4-a4af-01298489b6ed service nova] Acquiring lock "7d939b5e-fb83-47fd-93ff-b77618bd803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-02191640-898b-490e-bbd0-bab72d047f03 req-3e32dfab-b12d-48c4-a4af-01298489b6ed service nova] Lock "7d939b5e-fb83-47fd-93ff-b77618bd803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-02191640-898b-490e-bbd0-bab72d047f03 req-3e32dfab-b12d-48c4-a4af-01298489b6ed service nova] Lock "7d939b5e-fb83-47fd-93ff-b77618bd803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-02191640-898b-490e-bbd0-bab72d047f03 req-3e32dfab-b12d-48c4-a4af-01298489b6ed service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] No waiting events found dispatching network-vif-unplugged-2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG nova.compute.manager [req-02191640-898b-490e-bbd0-bab72d047f03 req-3e32dfab-b12d-48c4-a4af-01298489b6ed service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Received event network-vif-unplugged-2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 for instance with task_state deleting. {{(pid=71692) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:47 user nova-compute[71692]: INFO nova.virt.libvirt.driver [-] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Instance destroyed successfully.
Apr 13 19:44:47 user nova-compute[71692]: DEBUG nova.objects.instance [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lazy-loading 'resources' on Instance uuid 7d939b5e-fb83-47fd-93ff-b77618bd803f {{(pid=71692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG nova.virt.libvirt.vif [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T19:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1326800621',display_name='tempest-VolumesNegativeTest-instance-1326800621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1326800621',id=47,image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T19:43:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee076581e18f48349a20be41e4634b72',ramdisk_id='',reservation_id='r-l68gz8rn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e5467a4f-b219-48a2-9412-0a7e7ac851c3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1091777559',owner_user_name='tempest-VolumesNegativeTest-1091777559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T19:43:03Z,user_data=None,user_id='7cc805b367d6459f92d36f349737dc75',uuid=7d939b5e-fb83-47fd-93ff-b77618bd803f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "address": "fa:16:3e:a6:b7:a7", "network": {"id": "976efd77-35c0-4c51-b757-73c7706b082a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f4eeb05bf5be437ea14fbf6a38f497cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3f8ab5-d7", "ovs_interfaceid": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Converting VIF {"id": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "address": "fa:16:3e:a6:b7:a7", "network": {"id": "976efd77-35c0-4c51-b757-73c7706b082a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f4eeb05bf5be437ea14fbf6a38f497cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a3f8ab5-d7", "ovs_interfaceid": "2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG nova.network.os_vif_util [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:b7:a7,bridge_name='br-int',has_traffic_filtering=True,id=2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46,network=Network(976efd77-35c0-4c51-b757-73c7706b082a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3f8ab5-d7') {{(pid=71692) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG os_vif [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:b7:a7,bridge_name='br-int',has_traffic_filtering=True,id=2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46,network=Network(976efd77-35c0-4c51-b757-73c7706b082a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3f8ab5-d7') {{(pid=71692) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a3f8ab5-d7, bridge=br-int, if_exists=True) {{(pid=71692) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:44:47 user nova-compute[71692]: INFO os_vif [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:b7:a7,bridge_name='br-int',has_traffic_filtering=True,id=2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46,network=Network(976efd77-35c0-4c51-b757-73c7706b082a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a3f8ab5-d7')
Apr 13 19:44:47 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Deleting instance files /opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f_del
Apr 13 19:44:47 user nova-compute[71692]: INFO nova.virt.libvirt.driver [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Deletion of /opt/stack/data/nova/instances/7d939b5e-fb83-47fd-93ff-b77618bd803f_del complete
Apr 13 19:44:47 user nova-compute[71692]: INFO nova.compute.manager [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 13 19:44:47 user nova-compute[71692]: DEBUG oslo.service.loopingcall [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71692) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG nova.compute.manager [-] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Deallocating network for instance {{(pid=71692) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 19:44:47 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] deallocate_for_instance() {{(pid=71692) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 19:44:48 user nova-compute[71692]: DEBUG nova.network.neutron [-] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Updating instance_info_cache with network_info: [] {{(pid=71692) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 19:44:48 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Took 0.60 seconds to deallocate network for instance.
Apr 13 19:44:48 user nova-compute[71692]: DEBUG nova.compute.manager [req-26031fdc-0693-4695-9c83-d641c2d3bdaf req-37b0cf58-ba8f-424f-b22b-330d0083b484 service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Received event network-vif-deleted-2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:44:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:44:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:44:48 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:44:48 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:44:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:44:48 user nova-compute[71692]: INFO nova.scheduler.client.report [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Deleted allocations for instance 7d939b5e-fb83-47fd-93ff-b77618bd803f
Apr 13 19:44:48 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-f7286ed1-ea51-471f-87ff-bd6998fe729e tempest-VolumesNegativeTest-1091777559 tempest-VolumesNegativeTest-1091777559-project-member] Lock "7d939b5e-fb83-47fd-93ff-b77618bd803f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.798s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:44:49 user nova-compute[71692]: DEBUG nova.compute.manager [req-7a740f3b-6991-4de2-90c6-4b1532f7baa0 req-c108aad2-a59d-4d35-bd83-b2221713cfac service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Received event network-vif-plugged-2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 {{(pid=71692) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 19:44:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7a740f3b-6991-4de2-90c6-4b1532f7baa0 req-c108aad2-a59d-4d35-bd83-b2221713cfac service nova] Acquiring lock "7d939b5e-fb83-47fd-93ff-b77618bd803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:44:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7a740f3b-6991-4de2-90c6-4b1532f7baa0 req-c108aad2-a59d-4d35-bd83-b2221713cfac service nova] Lock "7d939b5e-fb83-47fd-93ff-b77618bd803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:44:49 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [req-7a740f3b-6991-4de2-90c6-4b1532f7baa0 req-c108aad2-a59d-4d35-bd83-b2221713cfac service nova] Lock "7d939b5e-fb83-47fd-93ff-b77618bd803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:44:49 user nova-compute[71692]: DEBUG nova.compute.manager [req-7a740f3b-6991-4de2-90c6-4b1532f7baa0 req-c108aad2-a59d-4d35-bd83-b2221713cfac service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] No waiting events found dispatching network-vif-plugged-2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 {{(pid=71692) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 19:44:49 user nova-compute[71692]: WARNING nova.compute.manager [req-7a740f3b-6991-4de2-90c6-4b1532f7baa0 req-c108aad2-a59d-4d35-bd83-b2221713cfac service nova] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Received unexpected event network-vif-plugged-2a3f8ab5-d7de-4717-bf4b-eb8b898b9b46 for instance with vm_state deleted and task_state None.
Apr 13 19:44:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:44:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:45:02 user nova-compute[71692]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681415087.7753065, 7d939b5e-fb83-47fd-93ff-b77618bd803f => Stopped> {{(pid=71692) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 19:45:02 user nova-compute[71692]: INFO nova.compute.manager [-] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] VM Stopped (Lifecycle Event)
Apr 13 19:45:02 user nova-compute[71692]: DEBUG nova.compute.manager [None req-e56c59a8-3807-42ea-b41a-720b8dea8787 None None] [instance: 7d939b5e-fb83-47fd-93ff-b77618bd803f] Checking state {{(pid=71692) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 19:45:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:45:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:45:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:45:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:45:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:45:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:45:06 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:45:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Didn't find any instances for network info cache update. {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:45:12 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:45:12 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:45:12 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8888MB free_disk=25.962772369384766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:45:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:45:13 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:45:13 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:45:14 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:45:15 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:45:17 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:45:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:45:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:45:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:45:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:45:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:45:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:45:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:45:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:45:23 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:45:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:45:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:45:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:45:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:45:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:45:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:45:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:45:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:45:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:45:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:45:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:45:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:45:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:45:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:45:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:45:48 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:45:52 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:45:57 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:46:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:46:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:46:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:46:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:46:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:46:02 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:46:06 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:46:07 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:46:12 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:46:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:46:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:46:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:46:12 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Auditing locally available compute resources for user (node: user) {{(pid=71692) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 19:46:12 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:46:12 user nova-compute[71692]: WARNING nova.virt.libvirt.driver [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 19:46:12 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Hypervisor/Node resource view: name=user free_ram=8902MB free_disk=25.961002349853516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71692) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 19:46:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 19:46:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 19:46:12 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 19:46:12 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71692) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 19:46:12 user nova-compute[71692]: DEBUG nova.compute.provider_tree [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed in ProviderTree for provider: 6ec8625c-38f9-4b14-a833-1c01964497f1 {{(pid=71692) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 19:46:12 user nova-compute[71692]: DEBUG nova.scheduler.client.report [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Inventory has not changed for provider 6ec8625c-38f9-4b14-a833-1c01964497f1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71692) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 19:46:12 user nova-compute[71692]: DEBUG nova.compute.resource_tracker [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Compute_service record updated for user:user {{(pid=71692) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 19:46:12 user nova-compute[71692]: DEBUG oslo_concurrency.lockutils [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=71692) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 19:46:12 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:46:13 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:46:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Starting heal instance info cache {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 19:46:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Rebuilding the list of instances to heal {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 19:46:13 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Didn't find any instances for network info cache update. {{(pid=71692) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 19:46:14 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:46:15 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:46:15 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:46:16 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:46:17 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:46:17 user nova-compute[71692]: DEBUG nova.compute.manager [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71692) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 19:46:17 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:46:22 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:46:24 user nova-compute[71692]: DEBUG oslo_service.periodic_task [None req-07d1bfaa-5bb6-483f-bb82-e956c6f12434 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71692) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 19:46:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:46:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:46:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:46:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:46:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:46:27 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:46:28 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:46:32 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:46:37 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:46:42 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:46:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 19:46:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 19:46:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71692) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 19:46:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:46:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71692) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 19:46:47 user nova-compute[71692]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=71692) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}